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About the Children Achieving Challenge 

The Children Achieving Challenge, estab- 
lished in 1 995> provides technical assistance 
and resource support to the School District of 
Philadelphia and its partners. Created through 
a grant from the Annenberg Foundation and 
matching support from other public and pri- 
vate funders, the Challenge will invest more 
than $150 million over a five-year period in a 
wide range of comprehensive school reforms. 
The Challenges role is to assist the District 
and its partners to move from multiple, 
diverse efforts to a collective focus and a new 
way of working together that can sustain itself 
long after the Challenge is gone. 

In its first year, the largest share of fund- 
ing has gone to support the development of 
new, tougher standards for academic subjects 
and student skills, and extensive professional 
development to strengthen leadership and 
improve classroom practice. In addition, the 
program has helped make possible a transi- 
tion to smaller, safer, more accessible school 
structures and groupings, increased parental 
and community involvement, better coordi- 
nation of health and social services and a 
broader model of career training and prepara- 
tion. Seven comprehensive workplans have 
been developed that serve as road maps for 
the School District and community partners as 
they work to implement a common agenda. 

Greater Philadelphia First houses the 
Challenge and provides oversight to it through 
the GPF Partnership for Reform. GPF is a 
not-for-profit association of the region’s largest 



employers, providing leadership on issues 
important to the economic development and 
quality of life of the community. 
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research on education policy, governance and 
finance. Members of CPRE are the Univer- 
sity of Pennsylvania; Harvard University; 
Stanford University; the University of 
Michigan; and the University of Wisconsin- 
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CPRE conducts research on issues 
such as: 

• Education Reform 

• Student and Teacher Standards 

• State and Local Politymaking 

• Education Governance 

• School Finance 

• Teacher Compensation 

• Student Incentives 

Consortium for Policy Research 
in Education 

Graduate School of Education 
University of Pennsylvania 
3440 Market Street, Suite 560 
Philadelphia, PA 19104-3325 
(215) 573-0700, ext. 0 






Table of Contents 



I. Introduction 1 

II. Activities of the Evaluation Team 8 

III. Children Achieving: The Theory of Action 19 

IV. The Context of Children Achieving 29 

V. The Progress of Reform 40 

VI. Building Capacity for Instructional Reform 56 

VII. The Family Resource Network 68 

Vm. Benefits of Children Achieving and Factors Affecting the Pace of Reform 77 

IX. Summary of Findings and Questions for Future Research 92 

Appendices are included in a separate volume. 




4 



Children Achieving Evaluation Team Members 



Consortium for Policy Research in Education 

Tom Corcoran, Principal Investigator 
Theresa Luhm 
Sandra Ham 
Ellen Foley 

Research for Action 

Jolley Christman 
Elaine Simon 
Eva Gold 
Pat McPherson 
Patti Buck 
Rhonda Phillips 

Organizational Management Group, Inc., Center for Collaborative Learning 

Bernard McMullan 
Joel Fontane 



ERIC 




I. Introduction 



The Children Achieving Challenge 

The Children Achieving Challenge, established in 1995, provides technical assistance and 
resource support to the School District of Philadelphia and its partners. Created through a grant 
from the Annenberg Foundation and matching support from other public and private funders, the 
Challenge will invest more than $150 million over a five-year period in a wide range of 
comprehensive school reforms in Philadelphia. The Challenge takes its name from Philadelphia’s 
Children Achieving education reform plan and the Annenberg Challenge Grant received by 
Philadelphia in February 1995. 

No American city as large and diverse as Philadelphia has succeeded in having the majority 
of its young people achieve at high levels. Philadelphia set out to be the first major city in the nation 
to meet this challenge. In 1994, David W. Hornbeck was recruited as Philadelphia’s 
Superintendent of Schools to help lead the effort. Upon his arrival, task forces of educators, 
community leaders and parents were formed and mapped out a broad plan. They called it Children 
Achieving. The final plan was adopted by the Philadelphia Board of Education in February, 1995. 
It set forth ten broad goals: 

1. Set high expectations for everyone by adopting new standards of performance. 

2. Design accurate performance indicators to hold everyone accountable for results. 

3. Shrink the centralized bureaucracy and let schools make more decisions. 

4. Provide intensive, sustained professional development for all staff. 

5. Make sure all students are healthy and ready for school. 

6. Create access to the community services and supports students need to succeed in school. 

7. Provide up-to-date technology and instructional materials. 

8. Engage the public in shaping, understanding, supporting and participating in school reform. 

9. Insure adequate resources and use them effectively. 

10. Address all these priorities together and for the long term, starting now. 

At the same time as the action plan for Children Achieving was nearing completion, the 
Annenberg Foundation offered a handful of America’s trouble cities the opportunity to vie for 
significant resources to restructure their public school systems. Philadelphia submitted its plan. As 
a result, the Annenberg Foundation designated Philadelphia as one of a small number of American 
cities to receive a five-year, $50 million Annenberg Challenge grant to improve public education 
and support implementation of Children Achieving. Among the conditions for receiving the grant 
was a requirement to produce two matching dollars for each one received from Annenberg, and to 
create a management structure other than the School District to provide program, fiscal and 
evaluation oversight of the grant. 

To meet these conditions, the District turned to the business community. Greater 
Philadelphia First (GPF) houses the Challenge and provides oversight to it through the GPF 
Partnership for Reform. GPF is a not-for-profit association of the region’s largest employers, 
providing leadership on issues important to the economic development and quality of life in the 
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community. The Partnership for Reform is composed of representatives from the GPF board, 
community organizations, the School District, and the Philadelphia Federation of Teachers (PFT). 

In any city the size of Philadelphia, there are hundreds of agencies, organization, 
corporations, foundations that along with the School District, work to improve the schools. Such 
organizations usually focus on specific areas or projects but are often unable to do much to 
improve the school system as a whole. The question addressed by the Challenge is how to focus 
these fragmented efforts. During its five-year tenure, the Challenge will try to move the district and 
its partners from multiple, diverse efforts to a collective focus and a new way of working together 
that can sustain itself long after the Challenge has finished its work. Challenge staff also manage 
programmatic and fiscal aspects of the grant and the matching funds. 

Challenge staff work with the district to convene workteams around specific components of 
Children Achieving. These workteams include teachers, school and cluster leaders, district staff 
from various offices and key partners from the community. Using the Children Achieving action 
plan and the Board of Education’s funding priorities for reforms as guideposts, the workteams 
meet regularly to define the specific work to be done to implement the ten point plan. The 
workplans outline the specific strategies and tasks to be accomplished and allocate available 
resources (District, Challenge, other partners). Workplans and workplan budgets are approved by 
the Board of Education and the Challenge’s Oversight Committee. Once workplans are approved, 
the workteams are expected to provide guidance during implementation, and to update the plans on 
an annual basis. 

Seven comprehensive workplans have been developed in the following areas: 

• Standards and Assessment 

• Leadership Development 

• Teaching and Learning 

• Community Services and Supports 

• School-to-Career Transition 

• Public Engagement 

• Technology 

• Evaluation 

In 1995-96 alone, the Challenge raised $92 million of its $100 million, five-year funding 
goal. In the first year of the Challenge, $20 million was allocated to a wide range of school district 
reforms. The largest share of funding went to professional development to strengthen leadership 
and improve classroom practice. In addition, the Challenge supported the district’s efforts to create 
smaller, safer, more accessible school structures and groupings, increase parental and community 
involvement, improve coordination of health and social service and develop a broader model of 
career training and preparation. 

The Evaluation of the Challenge 

The Children Achieving Challenge charged the Consortium for Policy Research in 
Education (CPRE) and its partners, Research for Action and OMG: Center for Collaborative 
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Learning with the evaluation of Children Achieving. The evaluation team’s plan was approved in 
December of 1995, and data collection was initiated in January of 1996. This report examines the 
progress of school reform during the last half of the 1995-96 school year, from January to June, 
1996 and should be viewed as a baseline document. It focuses on the progress of Children 
Achieving in the first six school clusters, as well as the issues and problems that have emerged 
during implementation. 

It should be noted that this report is incomplete in three important respects. First, since 
Children Achieving is a comprehensive reform and Philadelphia is a large district, it has not been 
possible to give equal attention to all aspects of the effort during this initial six-month data 
collection period. The evaluation team expended considerable effort on developing procedures and 
instruments, gaining entry to the clusters, and learning the “lay of the land.” Priorities had to be 
set, and the evaluation focused on the progress of some of the most critical components of the 
reform: the first six clusters, the Teaching and Learning Network (TLN), the small learning 
communities (SLCs), and the Family Resource Network (FRN). It would have been premature to 
address other aspects of the reform in the spring of 1996. For example, when data collection ended 
in May, councils were not operational in most schools in the first six clusters, leaving the team with 
little to say about anticipated changes in school governance. Similarly, draft standards were issued 
in June 1996 and the report has little to say about these proposed standards. In addition, it is too 
early to expect significant effects on teaching and learning. The report also lacks a districtwide 
perspective on the progress of reform because we chose to concentrate on the six clusters. A 
districtwide teacher survey, developed in cooperation with the district and originally scheduled to 
be administered in May, will now take place in the 1996-97 school year. Subsequent reports will 
present a districtwide perspective as all 22 clusters will be operational in 1996-97. 

Second, quantitative data collected by the district on student experiences and achievement 
will not be available until the fall. As a result, this report does not include baseline information on 
student achievement produced by the administration of the SAT9 or the data on student attendance 
and experiences in school. 

Third, a districtwide survey of SLCs, developed by the evaluation team for administration 
in May, was delayed. This data will not be available until the fall of 1996. 

The second of the three “data gaps” described above will be filled in the fall Of 1996, when 
the evaluation team submits a supplementary report. The first and third areas will be addressed 
through data collection efforts during the 1996-97 school year. 

Purposes of the Evaluation 

The evaluation of Children Achieving seeks answers to four basic questions about the 
implementation and effects of the reform. First, are the reforms being carried out in the manner 
envisioned — i.e., are they being successfully implemented? Second, as a consequence of the 
reforms, are the instructional practices of teachers and the learning experiences of students 
changing in ways that should improve outcomes? Finally, to what degree can any improvements 
be attributed to the reforms? These larger questions can be further broken down to capture specific 
aspects of Children Achieving. The subsidiary questions include: 

i 
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Implementation Questions 



Are the reforms coherent, and are they understood by those they affect? For example, do 
district, cluster, and school staff share a common vision of Children Achieving ? If not, 
how do their views vary, and what accounts for the variation? What are its effects? Are 
other stakeholders, including parents and the general public, aware of Children Achieving, 
and do they understand its philosophy, objectives, and strategies? 

Are the structural changes being implemented, and with what effects? What roles are the 
cluster offices playing, and what is their relationship with the schools? Are schools in the 
clusters creating SLCs? What are their characteristics? Do the SLCs have a clear 
instructional focus? Are the TLNs being established, and are they fostering effective 
relationships with the schools? Is the FRN functioning? Are parents more involved? Is the 
new governance structure functioning? 

Are the new district standards understood, accepted, and used? What are their effects on 
teaching practice? How do these effects vary and why? What types of curricular and 
instructional reforms are being fostered? How consistent are these reforms with emerging 
notions of good practice? Are the visions of the SLCs consistent with the proposed 
standards? Do the TLNs provide adequate support for implementing the standards? Is 
professional development adequately focused and of high quality? 

Are there systematic variations in the implementation of the reforms? Do some 
components move faster or slower than anticipated? Do some clusters do more or less than 
others? Do schools or SLCs with certain characteristics adopt reforms more readily and 
more effectively than others? 

What factors account for the variation in the pace or extent of implementation? What is the 
relationship between structural changes and the pace of instructional change? 

What issues or obstacles are encountered at different levels of the system? Why are they 
occurring? To what degree do they affect implementation? How are they addressed? 

With what success? 

How are external resources being mobilized and used? How effective are the district’s 
efforts to build its capacity to support reform? How effectively are different sources of 
external support coordinated? 

How do internal organizational issues such as communication, coordination, downsizing, 
capacity, ownership, and collective bargaining affect the implementation of Children 
Achieving ? 

How do political, fiscal, and legal contexts affect implementation? For example, is the 
district management structure changing and functioning in ways that support the reforms? 
What roles do the Philadelphia Education Fund (PEF) and other contributors to the reform 
play? Are their efforts coordinated with those of the district? 
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Effects Questions 



• Are the efforts of various district departments more focused and coordinated? Is adequate 
information available? Is it used? Are central units responsive to clusters and schools? 

Are district services and products valued? Are cluster services valued by the schools and 
SLCs? 

• Is there a greater focus on instruction, on students and on results in the schools? Is there a 
higher degree of collegiality, cooperation, and consensus on goals? Are there changes in 
resource allocation? 

• Is classroom practice changing? Are these changes consistent with emerging standards of 
good practice? What policies, strategies, and structures seem to be most effective in 
bringing about the desired practices? For example, are any of these measures associated 
with particular types of learning communities, professional development strategies, or 
leadership styles? 

• Are students working harder, doing better, and learning more? For example, is there better 
attendance, better discipline, higher achievement, and higher attainment? Are more 
students participating in demanding courses? Has the drop-out rate declined? 

• How do the outcomes vary? What accounts for the variation? What factors — particularly, 
what aspects of the reform — are most strongly affecting student outcomes? For example, 
is there greater improvement in achievement in cluster schools with the most “mature” 
SLCs, or in those with particular types of learning communities? What policies, strategies, 
structures, and practices seem to be most effective in bringing about the desired outcomes? 

Although all of these questions will eventually be addressed by the evaluation team, this 
report focuses on some critical issues surrounding Children Achieving s initial implementation in 
the first six clusters. The reader is reminded that this report is intended to provide baseline data, 
and that the questions it raises are intended to guide the next four years of research, not to reach 
premature conclusions about whether or not particular components of Children Achieving are 
successes or failures. It is simply too early in the life of the reform and the evaluation to deliver 
verdicts. 

In addition to providing credible evidence about the implementation and effects of Children 
Achieving, as well as feedback to the Challenge and the district, this evaluation is intended to build 
capacity at the district and cluster levels. For example, the evaluation team is helping the district 
make better use of data. This effort at capacity-building has taken the form of: 

• involving district evaluation staff in the design, analysis, and interpretation activities of the 
evaluation team; 

• helping the district develop and use new indicators aligned with its reform initiative; 

• developing new data sets (the teacher and student surveys) that the district can use and 
amend in the future; and 
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• working with the cluster leaders to help develop strategies and indicators for monitoring the 
progress of reform in their schools, and assisting in the interpretation of that data. 

The evaluation team is also providing feedback on the progress of implementation to the district 
leadership and to the cluster leaders. 

Focusing on the “Joints in the System” 

There are several levels of evaluative inquiry underway. The evaluation team is: 

• monitoring student outcomes and examining their variation across sites and over time; 

• tracking changes in instructional practice, changes in the experience of students in school, 
and the relationship of these changes to outcomes; 

• tracking changes in school organization (such as SLCs) and changes in the culture and 
climate of schools, as well as determining the relationship of these issues to changes in 
teaching and learning and outcomes; 

• examining the roles and activities of intermediate structures, such as clusters, the TLN, the 
FRN, and other networks or collaboratives that are formed by schools or teachers; 
determining their relationships to the schools; and tracking the pace and nature of reforms 
in schools; 

• examining the relationships among the intermediate structures and between these 
structures and the central office; and 

• examining the relationships among the intermediate structures, the central office, and local 
partners and support organizations. 

At each of these levels, the logic of the evaluation dictates that we examine the co-variation of 
indicators of change within and across levels of analysis, developing hypotheses to explain the 
patterns observed and the degree to which they can be attributed to the reforms associated with 
Children Achieving. It is at the horizontal “joints” between activities at the same level, and at the 
vertical “joints” between the levels of the system, where implementation problems are most likely 
to occur. For example, in terms of horizontal linkages, do the TLN activities and the work of 
external support agencies push practice in the same direction? Or, within the schools, how do the 
local school councils and SLCs interact? Examining vertical linkages leads to questions such as: 

Do the standards affect the development of SLCs and influence practice? How does the cluster 
system support the desired changes in the schools? Do the SLCs lead to changes in classroom 
practice? 

Twice each year, during the summer and mid-winter, the evaluation team will examine the 
patterns of co-variation in the indicators of implementation, changes in practice, and student 
performance. Based on this analysis, the team will develop hypotheses to be examined in 
subsequent data collection and select a purposive sample of schools to test those hypotheses 
through qualitative fieldwork. 
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Organization of the Report 

The report is organized into nine sections, which in turn are organized around broad 
themes. Findings from CPRE’s interviews of district and cluster staff are integrated with findings 
from interviews and observations conducted in a sample of schools by Research for Action. This 
first section provided an overview of the evaluation and reviewed the questions that guided data 
collection. Section II offers a brief description of the work completed by the evaluation team and 
the methods of data collection employed. Section III examines the theory of action underlying 
Children Achieving and the degree to which it is being communicated to school staff. Section IV 
reminds the reader of the turbulent environment within which Children Achieving is being 
designed and implemented, and discusses the effects of recent events on the progress of reform. 
Section V reports on the progress made during 1995-96 in the first six clusters. Sections VI and 
VII report on the implementation of two particularly critical components of the reform agenda, 
those aimed at building capacity to improve instruction and those aimed at strengthening social 
supports for children. Section VIII presents some hypotheses about factors enhancing or inhibiting 
the pace of reform in schools. The final section provides a summary of the findings and 
recommendations of the evaluation team. 
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II. Activities of the Evaluation Team 



The evaluation team initiated six streams of work during Phase Two 1 of the Children 
Achieving Evaluation: 

• the initial studies of the district and cluster roles in implementing Children Achieving and 
the organizational restructuring that occurred at these levels; 

• the design of a teacher survey for administration in the fall of 1996; 

• the development of an indicator system for the School District of Philadelphia; 

• the study of the initial sample of schools; 

• the creation of a consolidated database for the evaluation; and 

• the submission of the evaluation plan to the Annenberg Institute for review and approval. 

The first two and last two tasks were the primary responsibility of CPRE. OMG undertook the 
third task, and Research for Action was responsible for the fourth. Additionally, CPRE was 
responsible for the evaluation’s overall management, for the coordination of work, and for the 
analysis and integration of findings. The specific work completed in relation to these tasks is 
described below. 

Task One: Documenting the District and Cluster Roles in Implementing 
Children Achieving 

Beginning in December of 1995, CPRE staff documented the design and initial 
implementation of Children Achieving. To accomplish this, CPRE staff conducted interviews 
with key central office staff, cluster leaders, TLN coordinators, FRN coordinators, and staff at the 
Philadelphia Education Fund and reviewed a variety of documents produced by the district. 
Respondents were asked about their vision for reform; their roles and responsibilities in 
implementation; their recent activities; the policies, procedures, and strategies being used; the 
nature and levels of support and collaboration being provided; sources of support; relationships 
within and across levels; and issues, barriers, and problems encountered. CPRE staff developed 
protocols for interviewing the cluster leaders and district officials (see Appendix A for the full 
protocols and the list of those interviewed). In addition, CPRE staff observed a number of district 
meetings and cluster activities. 



Field notes and reports from the cluster-, school-, and district-level were coded and placed 
in a database, permitting the evaluation team to access and analyze data relating to components of 
Children Achieving or to other key variables across sites and over time, without losing the context 



1 Phase One included planning and design; document review; and some initial tracking of implementation during the 
summer and fall of 1 995. 
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of the original interviews. This effort also facilitated data reduction and display, mapping 
relationships among variables, and the development of hypotheses. 

Task Two: Development of the Teacher Survey 

A second task initiated by CPRE was the development of a teacher survey. As discussed 
in the Phase II proposal, the purpose of the teacher survey is to paint a broad picture of the 
progress of reform in schools and classrooms, as well as its effects on curriculum, instruction, 
assessment, school climate, governance, and community relations. The survey data will permit 
analysis of the co- variance between indicators of the degree of implementation in schools and 
quantitative data on student outcomes. This analysis will be used to develop hypotheses about 
causes and effects that will be tested through an in-depth analysis of smaller samples of schools. 

CPRE originally intended to administer this survey in the fall of 1996, with a second 
administration in the fall of 1998, but when school district officials announced plans to administer 
their own survey during the spring of 1996 and requested assistance with its design, CPRE stepped 
up its schedule to collaborate in the development of a common instrument. The plan was to 
administer the survey in May of 1996 in the first six clusters. However, in May, district officials 
decided to wait until 1996-97 to administer the survey in all schools in the city, and CPRE agreed 
to accommodate this schedule. 

To facilitate the survey development process and reduce costs, CPRE and district officials 
have modified an instrument used in Chicago by the Consortium for Chicago School Reform to 
examine the progress of school reform in that city. Modifications have been made to fit the 
dimensions and language of Children Achieving. In addition, in order to reduce the burden on 
Philadelphia teachers, CPRE has accommodated requests to include questions from Dr. Kenneth 
Wong of the Mid-Atlantic Regional Laboratory, which is studying changes in Title I, and from Dr. 
Milbrey McLaughlin and Dr. Joan Talbert of Stanford University, who are evaluating the DeWitt- 
Wallace Students at the Center program in two clusters. CPRE staff are also working with the 
evaluations from the other Annenberg sites to develop some common survey items which will 
contribute to cross-site analysis and a “national” evaluation of the Annenberg Challenge. 

Three meetings were held to discuss modifications to the Chicago survey instrument. 
Participants in addition to CPRE staff included: Linda Silverberg, Administrative Assistant, Martin 
Luther King Cluster; Cleo Figgures, Administrative Assistant, Case Cluster; Betsy Useem, 
Philadelphia Education Fund; Elaine Simon, Research for Action; Tom Clark, district Director of 
Research and Evaluation; Hal Moss, Philadelphia Federation of Teachers; Rhe McLaughlin from 
the Office of Schools; and Rob Sebastian, Tom Bemas, and Mike Schlesinger from the district 
Office of Accountability and Assessment. CPRE hired Karl Landis from the Institute for Survey 
Research at Temple University as a consultant to review the instrument. 

A draft of the survey is included in Appendix B of this report. It was reviewed in the 
summer of 1996 by the group listed above and will be reviewed by teachers and cluster leaders 
before the survey is administered in the fall. The school district has agreed to produce, administer, 
and collect the surveys. 
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Task Three: Development of an Indicator System 

Between December of 1995 and June of 1996, staff at OMG concentrated on two primary 
activities: working with the School District of Philadelphia’s Office of Management Information 
Services (MIS) to develop a baseline analysis file reflecting the experiences of students enrolled in 
the school district during the 1994-95 school year; and working with the School District of 
Philadelphia’s Office of Accountability and Assessment to develop a strategy for collecting 
baseline information on the location, characteristics, and plans for SLCs in operation during the 
1995/96 school year. 

Baseline Data (1994-95 School Year) 

As part of the evaluation planning process, OMG prepared a list of indicators reflecting the 
characteristics and experiences of School District of Philadelphia students and school staff. Using 
these lists as a template, OMG staff worked with MIS to classify the indicators into three distinct 
classes, based on their availability in existing school district computerized files. The three 
categories are described below. 



Students 

Category I: These data include indicators of student experiences and characteristics that 
are collected and maintained by the district and in a form which makes them readily transferable for 
use in analyses. This category includes basic demographic indicators (gender, race/ethnicity, and 
date of birth) and recent school experiences (school assigned, LEP, Special Education services, 
suspension experience, attendance, report card marks, and active/withdrawal status). These 
indicators are collected in the normal course of district operations. Data quality is generally 
regarded as relatively high, although some omissions and errors can be detected. 

Status : MIS staff have provided an initial beta-test “flat” database for the 1994-95 school 
year to identify the conceptual and technical issues involved in creating the analytic “base” of 
students to be used in monitoring student experiences and performance. The initial data file 
revealed that the district, as part of its regular operations, maintains data on a substantially larger 
population of students than those who actually receive educational services in district schools. The 
records maintained by the district include students enrolled in area parochial schools who are 
provided Title 1 services; special education students with substantial educational and support needs 
who are enrolled in private settings; and a variety of additional students who either have not 
enrolled in a public school after applying or have moved from Philadelphia (the district has no 
further enrollment information on these students, however). Discussions with district staff and the 
evaluation team have helped refine criteria for establishing a set of students whose experiences will 
be used for analysis. In general, the analytic base will include all students ever enrolled in a School 
District of Philadelphia school during the regular academic year. Only students who have 
withdrawn from the district to attend school in another district, who are incarcerated, or who are 
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deceased will be excluded. Students who withdraw or drop out (except for those explicitly noted 
above) will be included in analysis. 2 

Category II: These data include indicators of student experiences and characteristics that 
are collected and maintained by the district but for which additional data reduction and processing 
is required before they are ready for use in analysis. The information includes: 

• indicators requiring a summary of students’ records across multiple school years, such as 
total time enrolled in the district, prior enrollment patterns, kindergarten experiences, prior 
promotion/retention experiences, and school-to-school mobility; 

• indicators requiring the creation of a single, appropriate variable to summarize several 
educational experiences or decisions, such as magnet/special admissions applications 
experiences, enrollment in “out-of-cluster” school settings, and participation in “gateway” 
courses; 

• indicators based on data collection efforts that are either not universal or have been 
substantially altered or suspended. Among these are achievement testing data and Title 
I/Chapter I testing results; and 

• indicators requiring authorization or waivers for release. (The most critical items in this 
category are data related to family economic status. The district receives data from the 
Commonwealth on AFDC receipt by families but is precluded from matching it to student 
records by electronic or other means without authorization. Discussions are underway to 
determine whether an appropriate waiver can be granted for these analyses or if another 
acceptable method for accessing comparable data can be initiated.) 

Status : MIS staff are addressing these issues. For example, enrollment in kindergarten 
since 1990-91 will be flagged as a student experience. However, for students in elementary 
grades, there is still work to be done. For example, frequencies related to special 
admissions/magnet enrollment have not yet been prepared or provided to OMG in order to permit 
decisions about the definition of an appropriate summary indicator. 

Baseline testing data were collected using the Stanford 9 (SAT9) achievement test across 
grades 2, 4, 6, 8, and 1 1 during the spring of 1996. This test replaces the annual CTBS testing that 
was used in grades 1 through 8 in 1993-94. During the 1994-95 school year, the CTBS was 
replaced by the SAT9 in the initial six clusters for students in grades 4 and 8 but was continued in 
all other elementary and middle schools for that year. Chapter I/Title I testing was suspended by 
waiver for the 1994-95 school year and has not been administered during the 1995-96 school year. 

Category III: These data include indicators of student experiences and characteristics that 
are not currently collected systematically by the district and for which a data collection plan must 



2 For example, students who drop out of school will be included in the denominator in any analyses of normal 
progress, the percentage passing major subjects, etc. 
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be devised and implemented. The most critical of the data elements that fall into this category are: 
assignment to, participation in, and experiences with SLCs; and postsecondary experiences. 

SLCs, in the form of charters, have existed within comprehensive high schools for several 
years. According to reports by the Office of Senior High Schools, virtually all students in 
comprehensive high schools were affiliated with an SLC during the 1995-96 school year. This 
office has used student roster assignment information maintained by MIS to gauge the 
“authenticity” of the charter assignment within these schools through an auditing process that is 
conducted in the fall semester. 

Status'. At present, despite the apparent tremendous growth of SLCs across the district, no 
process for identifying and monitoring SLCs in grades K through 8 has been established. Further, 
the staff who reviewed and monitored SLCs in comprehensive high schools have been reassigned 
as part of central administration staff-reduction efforts. The development of SLC communities is 
of interest to the district’s finance and budgeting offices, and they are developing accounting 
strategies to track budget allocations and expenditures at the SLC level. They have adopted a 
standard system for assigning each SLC a unique program identification number and are re- 
orienting their accounting and reporting functions to allow the disaggregation of allocations and 
expenses by SLC. 

The evaluation team’s proposed analyses of the effects of Children Achieving on classroom 
practice and student performance are premised on the capacity to track and assess the development 
of SLCs and relate their characteristics to these outcomes. Consequently, the team will be working 
closely with district staff to understand how decisions about SLC review and official designation 
certification are made. We will be working with MIS to develop a structured, consistent method 
for tracking student and teacher affiliation with SLCs. To that end, we have provided MIS with a 
list and a preliminary ID numbering scheme for the 410 SLCs that were identified as operational by 
principals for the 1995-96 school year in a May of 1996 survey designed by OMG and the district. 
We have been told that this ID numbering system will be adopted as the basis for tracking student 
and teacher affiliation with SLCs in the future. 

The Children Achieving agenda also calls for measuring the success of schools’ ability to 
prepare children for successful entry into adult life. Evidence of that success could be obtained by 
interviewing or surveying recent graduates of Philadelphia high schools. Several discussions about 
a follow-up survey of graduates have occurred, but no final decisions have been reached on the 
scope of the survey, its timing, or its funding. Neither the administration nor the analysis of a 
survey of graduates was included as part of the evaluation plan submitted to the Annenberg 
Challenge. 



Faculty 

Indicators related to the characteristics of faculty have not yet been the focus of substantive 
discussions with MIS. However, informal discussions have revealed the following: 

• basic demographic information is available; 

• information about length of assignments to a particular school may be problematic; 
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• information on teacher affiliation with SLCs has not yet been collected and no plan has yet 
been developed (although the accounting department’s new system may provide a 
foundation for such an effort); and 

• tracking of teacher participation in Annenberg-supported, PEF-supported, or other district- 
supported professional development activities related to school reform is not part of the 
current (or planned) teacher database system. 

Identifying Small Learning Communities 

OMG’s second major activity during the period between December of 1995 and June of 
1996 was to develop a survey for collecting basic information about the SLCs in operation during 
the 1995-96 school year. When Children Achieving was initiated, SLCs (charters) were a defining 
feature of many of the district’s comprehensive high schools. In fact, the Office of Senior High 
Schools reported that virtually all students enrolled in these schools in 1995-96 were associated 
with one of 132 distinct SLCs. However, no data on the development of SLCs in other settings 
were available. There was no systematic approach to track the development of SLCs in schools 
other than comprehensive high schools. The evaluation team recognized the need to catalog the 
number and type of SLCs that existed as Children Achieving began its implementation phase. 

Small Learning Community Survey 

In an effort to collect comparable data about each SLC operational during the 1995-96 
school year, the evaluation team decided to collect basic data from the coordinator or lead teacher 
of each SLC (or similar program). To identify all of the SLCs in the district, principals at all 
elementary, middle, and non-comprehensive high schools were sent brief identification forms and 
asked to name all of the SLCs in operation at their school and each leader teacher/coordinator. The 
accompanying letter summarized the guidelines that the district had defined for the development of 
SLCs. Principals were asked to refer to these guidelines when identifying SLCs at their schools. 
Information or completed forms were received from 226 of the 234 principals contacted. 

Based on comments from district staff familiar with the schools, the evaluation team 
anticipated that the incidence of SLCs would remain biased toward comprehensive high schools. 
However, it became apparent that many schools were implementing SLC approaches. In addition 
to the 132 charters/SLCs within the comprehensive high schools, principals in other schools 
identified more than 275 additional SLCs (See Table 1). This response far exceeded expectations. 



17 



Evaluation of the Children Achieving Initiative: Report on Year One 



13 



Table 1. Number of Small Learning Communities 
by School Type (1995-96 School Year) 



School Type 




Vumber of Principals Nominating: 


No 

SLCs 


1 

SLC 


2 

SLCs 


3 

SLCs 


4 

SLCs 


5 

SLCs 


6 or 
more 
SLCs 


Whole 

School 

SLC 3 


Total 

SLCs 

Reported 


Comprehensive High 
School 


0 


0 


0 


2 


4 


i 


15 


0 


132 


Other High School 


,9 


3 


0 


2 


1 


2 


0 


1 


24 


Middle School 


11 


4 


2 


2 


15 


1 


4 


1 


110 


Elementary School 


106 


22 


14 


18 


4 


2 


3 


1 


144 






















Total 


126 


29 


16 


24 


24 


6 


22 


3 


410 4 



Since the principals were asked only to provide a name and contact person for the SLCs 
they indicated, it was not possible to assess how many of these newly identified programs satisfied 
the guidelines established by the district. However, the names of some of the nominated programs 
(i.e., 1st Grade, 7th Grade, Title 1 Program) suggested that they might not all be the kind of SLCs 
envisioned in the Children Achieving design. In the interest of being comprehensive, the decision 
was made to include all nominated SLCs in the next phase of the study — a survey of SLC leader 
teachers/coordinators. 

A survey was designed to collect information about the degree to which these SLCs were 
addressing the guidelines developed by the district. This survey was pre-tested with SLC leaders 
in three different schools — one high school, one middle school, and one elementary school — and 
was revised based on their comments, as well as the suggestions provided by others who reviewed 
the instrument. 

Coordinators or leaders of every SLC identified by the principals received the survey in 
early May and were asked to return it before the end of that month (a copy of the survey instrument 
is included in Appendix C). In the third week of May, the district’s liaison was informed by 
Philadelphia of Federation of Teachers (PFT) leadership that they had directed their members not 
to complete the survey. An electronic message was transmitted to all schools by PFT telling SLC 
leaders to ignore the survey. After several weeks of discussion between the PFT and the district 
liaison, they agreed to instruct teachers to ignore those items requesting the SLC leader’s 
assessment of how supportive teachers and others were of the SLC concept and an item concerning 
the locus of control over professional development opportunities for SLC teachers. 

By July 1, completed questionnaires had been received from only 152 of the 410 nominated 
SLCs (37 percent). Completion rates were highest among SLCs in non-comprehensive high 



3 Principals of several small magnet schools reported that their entire school operated as an SLC. 

4 The total number of SLCs reported in this column does not sum across each row, because the totals were derived by 
multiplying the frequency reported in each column times the number of SLCs in the column header. The actual 
number of SLCs reported in each school was used in the aggregated category “6 or more.” 
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schools (70 percent) and elementary schools (44 percent). Submission rates were substantially 
lower among comprehensive high schools (36 percent) and middle schools (22 percent). With the 
exception of the SLCs in comprehensive high schools, the non-response problem might be 
attributed in part to poor identification (i.e., programs were nominated by principals as SLCs, but 
their named coordinators ultimately may have determined that they could not address the questions 
raised) and in part to confusion caused by the dispute over the survey. The timing of the survey and 
the delays caused by the dispute over the items also obviously also contributed to the lower-than- 
desired response rate. 

The review and coding of completed questionnaires began in the summer of 1996; 
however, given the low completion rate, none of the anticipated analyses can be undertaken until 
comparable information is collected from all SLCs. Based on the insights gained from this review 
and the PFT’s suggestions, the evaluation team will work with the district to re-administer a 
revised instrument at the beginning of the next school year to all SLCs that did not respond this 
spring. 



It is anticipated that, in the spring of 1997, SLCs leaders will be contacted again to update 
the information collected through this initial effort. The evaluation team, working with district 
staff, will seek to provide the information collected during this first phase in a standardized format 
for easy review and revision by SLC leaders. Only leaders of SLCs opening during the 1996-97 
school year will be asked to complete a full questionnaire about their initiatives. 

School/Principal Survey 

At the same time the SLC survey was being administered, a parallel effort was underway 
to collect additional information about SLC decision making, context, and planning at the school 
level. A brief survey was sent to every principal. A copy of this instrument is also included in 
Appendix C. Although some principals were confused about whether or not they were expected to 
complete the survey, the overall rate of return was high. By July 1, 201 of the 256 (79 percent) 
principals had returned completed surveys. 

A review of the questionnaires completed by principals reveals that a substantial number of 
new SLCs are expected to become operational during the 1996-97 school year in elementary and 
non-comprehensive high schools. This finding underscores the critical need to establish a process 
for reviewing, assessing, and tracking SLCs across the entire district as a normal part of school and 
administrative operations. 

Task Four: Children Achieving in the Schools 

During Phase II of the evaluation, Research for Action staff visited a number of schools to 
document the implementation of Children Achieving and identify factors affecting implementation 
of the reforms. They also identified important dimensions to be used in selecting schools for case 
studies next year. 
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The Identification of a School Sample 



Research in the spring of 1996 focused on identifying and understanding the variety of 
ways in which the schools are responding to Children Achieving. Schools were selected that 
represented contrasting contexts and approaches to practice along such dimensions as governance, 
community engagement, and teaching and learning strategies. Ultimately, eleven schools in three 
of the first six clusters were examined in some depth. With the help of the Office of Schools and 
cluster leaders, four middle and four elementary schools were selected in addition to the three 
cluster high schools. Letters from Rhonda Lauer of the Office of Schools and from CPRE 
introduced the research team to principals and, in some cases, local school councils. 

Protocol Development 

Research for Action staff developed a detailed set of protocols (see Appendix A) for the 
interviews with school community members and the observations that took place in the spring. The 
four broad questions addressed were: 

• What history does the school bring to this reform effort? How is the Children Achieving 
agenda an extension of or a departure from this history? 

• What is the vision of reform at the school? What factors influence its development? To 
what degree is it shared among staff and within the community? 

• What changes related to the implementation of Children Achieving are taking place at the 
school — including standards-driven teaching and learning, SLCs, support for children and 
families, and decentralized decision making? 

• What kind of support is the school receiving from its cluster and from the TLN? How 
useful is this support? 

Protocols were developed for interviews with principals and school-level administrators, 
teachers, parents, and counselors/nurses/school-community liaisons. A general observation 
protocol, and student focus group questions, were also developed. In each school, the fieldwork 
schedule included interviews with the principal, members of the leadership team, teachers 
(including local school council members and union representatives), the counselor/nurse/school- 
community coordinator, SLC coordinators, parents (including local school council members), and 
students. Observations included those events that school personnel identified as exemplary of the 
local vision of reform, local school council meetings, professional development sessions, and 
planning meetings. Fieldwork was conducted between February and the end of May. 
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Task Five: Developing an Integrated Database 

In order to ensure that the progress of the reforms can be accurately tracked over time and 
that a co-variance strategy can be used to develop and test hypotheses about the effects of the 
reforms, CPRE has asked its subcontractors to provide raw data for inclusion in a common 
database. The qualitative data from interviews and observations were coded and are maintained in 
files that permit comparative analyses across schools and clusters over time. The codes were 
derived from the conceptual framework guiding the evaluation and from the key concepts identified 
in the broader literature on school reform. This approach allows qualitative data to be analyzed 
with the same precision as quantitative data. 

Task Six: Obtaining Approval of the Design from the Annenberg Institute 

CPRE was responsible for assuring that the evaluation plan submitted to the Children 
Achieving Challenge was reviewed and approved by the Annenberg Institute. This process began 
in April of 1996, when the Institute announced a strategy for reviewing the plans. Donald Schon 
from the Massachusetts Institute of Technology (MIT) was retained as the reviewer by the 
Institute. Philadelphia and Chicago were to be reviewed first, since they were the only sites with 
fully developed evaluation plans. 

At the end of April, the evaluation team received a memo from Schon that related generally 
favorable comments on the plans for evaluating Children Achieving. Schon described the plan as 
“a model that can be put to good use by the other [Annenberg] sites.” He felt that it was a serious 
and comprehensive approach that managed the complexity of large-scale reform in a coherent way. 
He particularly liked the coordinated use of aggregate quantitative analyses and qualitative school- 
level work, as well as the team’s plans to integrate the two approaches in data collection. 

Schon raised some specific questions about the “theory of action” that underlies Children 
Achieving, and asked CPRE to be more explicit about its elements and how the evaluation would 
address them. He also raised questions about how the evaluation team would deal with the issue of 
attribution, that is, proving that the effects observed were caused by the reforms. He asked the 
team to be more explicit about how this analytic problem would be handled. 

The former problem was easily addressed, but the latter, the problem of attribution, led to 
some lengthy discussions among the evaluators. Two significant changes, approved in July of 
1996, resulted from these discussions. The first was a shift in strategy from the documentation of a 
set of schools over a four-year period to one in which school-level work would be used to provide 
detailed evidence to support specific hypotheses about the causal linkages between components of 
Children Achieving and changes in teaching and learning. This approach entails altering the 
sample of schools each year, or even bi-annually, in order to answer adequately questions arising 
from the previous year’s data collection and analysis. In this way, co-variations between survey 
data and indicators of effects (e.g., achievement tests) can be used to develop hypotheses about 
how Children Achieving is affecting, or not affecting, the schools. These hypotheses will be tested 
by selecting an appropriate school sample for qualitative work in the next time period. That work 
can also lead to changes in the survey. The second decision was to administer the survey 
instrument in 1996, 1997, and 1998, rather than only twice as originally planned. 

21 
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Project Management and Coordination 

CPRE is responsible for overall project management and coordination. During Phase II, 
this effort involved scheduling and conducting team meetings, organizing joint team fieldwork in 
three clusters and two schools, training the team to use the coding and data management system 
(Ethnograph), and preparing all reports. It also has involved on-going discussions with the 
Philadelphia Education Fund, the William Penn Foundation, and the new Mid-Atlantic Regional 
Educational Laboratory about the studies of Children Achieving that they are currently 
undertaking. In each case, the purpose and the design of these studies overlaps with the evaluation. 
These studies offer the possibility of obtaining larger samples and a richer database. They also 
threaten to overload already over-burdened school and cluster personnel and to reduce their level of 
cooperation with the evaluation team. For this reason, CPRE is making every effort to coordinate 
with these other research projects and to avoid redundant data collection. 
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III. Children Achieving : The Theory of Action 



To assess the progress and effects of a comprehensive reform such as Children Achieving, 
it is essential to understand the “theory of action” that underlies it. What actions and patterns of 
behavior do the architects and advocates of the reform believe will bring about the improved state 
of affairs that they seek? If their theory of causation is understood, some sense can be made out of 
the many decisions, actions, and messages associated with a comprehensive reform initiative. A 
theory of action is more than just a vision of a future state of affairs; it is a set of propositions about 
what must be done in order to achieve the desired ends. It is a theory about deliberate human 
behavior, and it follows a causal path — action “A” produces condition “B,” which leads to the 
outcome “C.” For the agent of reform, it defines the strategies for producing the desired results, 
but for the observer of reform it offers a way of mapping, explaining, predicting, and evaluating 
events. 



The Annenberg Institute has asked all of the evaluators of the Challenge sites to explicate 
the theories of action being followed by their initiatives, to compare them to what is actually being 
done in those sites, and, if the theory is put into practice, to determine the degree to which it leads 
to the desired results. This approach helps reveal the assumptions being made, the critical linkage 
points in the plan, and the critical challenges that the reform is likely to face. It also focuses the 
evaluation on the most critical aspects of the reform. 

Philadelphia’s Theory of Action 

The principal architect of Children Achieving is Superintendent David Hornbeck, who 
brought the plan to Philadelphia and was, in fact, hired to implement it. Hornbeck sincerely 
believes that incremental reforms achieve little, that the stakes must be raised, and that radical, 
comprehensive changes are required to help urban children achieve at high levels. His vision has 
been adopted by the Board of Education as the “ten components” of Children Achieving. In his 
own words, Hornbeck explains: 

There are ten components of comprehensive, systemic change that must occur over the 
next five years if we are to have the learning environment in schools and communities in 
which large majorities of all children demonstrate high achievement. In broad terms, they 
are: 

I. We must behave as if we believe that all students will learn at high levels.... 

II. Standards-based reform will drive the system.. ..We must set standards, have new 
assessment strategies, and develop new incentive systems for both adults and students in 
the system. 

III. Decisions will be made at the school level. Professionals who are expected to 
produce results with consequences based on those results, also must have the right to 
determine how they practice their profession. Authority for decisions about personnel, 
budget, professional development, instructional strategies and curriculum, scheduling, 
student and teacher assignments inside of a school, and, perhaps, discipline, should be 
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made at the school level. ...In addition, to school employees, parents must also be partners 
in making those decisions.... 

IV. Staff development is critical to improved performance.... 

V. Early childhood support is less expensive and more effective.. ..There are at least three 
areas of focus important to school readiness: family support; health and social services; 
and full-day kindergarten, pre-kindergarten, and child care. 

VI. Community services and supports can make the difference between success and 
failure. Children who are unhealthy, hungry, abused, ill housed, ill clothed, or otherwise 
face the kinds of problems outside of the school borne of poverty can not achieve at high 
levels. Therefore, it is imperative that initiatives be dramatically expanded to provide the 
necessary services and supports to reduce the impact of these major barriers to learning. 

VII. Adequate technology, instructional materials, and facilities are necessary to 
learning.... 



VIII. Strong public engagement is required. Unless parents, civic leaders, elected 
officials, the business community, post-secondary educators, and the wider citizenry 
understand and support radical change, we cannot sustain it.... 

IX. We must have adequate resources and use them effectively.... 

X. We must do all of these nine components. The agenda is not a ‘pick and chose menu.’ 
We must approach the challenge of education reform in a comprehensive and integrated 
way. If one or more features of the whole agenda is not implemented, its power to yield 
high performance by all students will be significantly diminished . 5 

However, the theory of action underlying this vision for Children Achieving — that is, the 
dynamic relationship among the elements that will lead to improved performance — is not explicit in 
this list of components. Based on other statements made by Superintendent Hombeck, the theory 
of action underlying Children Achieving would seem to be: 

Given high academic standards and strong incentives to focus efforts and resources; 
greater control over school resource allocations, organization, policies, and programs; 
adequate funding and resources; more hands-on leadership and high-quality support; 
better coordination of resources and programs; restructured schools in order to support 
good teaching and encourage improvement of practice; rich professional development of 
a person’s own choosing; and increased public understanding and support, the teachers 
and administrators of the Philadelphia schools will develop, adopt, or adapt instructional 
technologies and patterns of behavior that will help all children reach the district’s high 
standards. 



5 “ Children Achieving." A Statement by David Hombeck, Meeting of the Philadelphia Board of Education, August 
22, 1994, pp. 3-5. 
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This theory is presented in simplified form in Figure I. While this diagram suggests a 
linear model of change that oversimplifies the theory, it is nevertheless useful because it identifies 
the critical domains of action that must be examined by the evaluation and suggests the “joints” in 
the new system where problems may occur. 

The critical “drivers” in this theory are the standards and incentives embedded in the yet-to- 
be-defined accountability system. It is important to note that neither of these elements of Children 
Achieving were in place in 1995-96. The focus of the first year’s work was to develop standards, 
to put the infrastructure in place that would support reforms in schools and classrooms, to establish 
the relationships necessary to make the new infrastructure work, to prepare teachers to meet the 
new standards, and to design and win support for the accountability system and its incentives. The 
“drivers” will come into play over the next two years, as the standards and accountability 
procedures are implemented. 

Another interesting aspect of the ten-point plan is that neither the cluster organization nor 
the SLCs are identified as explicit components, although they are nonetheless essential parts of the 
underlying theory of action. These elements provide leadership and support on the one hand and 
improved conditions of teaching and learning on the other. Teaming and networking are being 
encouraged at all levels of the system and are valued as sources of motivation, support, and 
efficiency. Children Achieving seeks to raise productivity and improve quality by reducing the 
isolation of Philadelphia’s students, teachers, schools, and administrators at all levels. 

Given this theory, and the particular sequence of its implementation, it is unlikely that 
widespread changes in professional practice would have occurred during the first year. The 
elements that would have led to such a change were simply not in place. However, it is not 
unreasonable to assume that increased professional development and opportunities provided 
through the decentralization of authority, as well as an anticipation of standards and incentives, 
would have led the most creative, energetic, and reform-minded educators to initiate changes. 
Conversely, those who are opposed to reform, those who are unfamiliar with the concept, and those 
who are apathetic or comfortable with the status quo might be expected to wait and watch in the 
hope that the “drivers” would never materialize. As a result, the theory predicts uneven results in 
these early stages of reform. 
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Figure 1. Children Achieving ’s Theory of Action 
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Comparisons to the Kentucky Education Reform Act 



Both the supporters and the critics of Children Achieving often compare its design — or, its 
theory of action — to the Kentucky Education Reform Act (KERA). The comparison should be 
expected, since David Hombeck was also involved with the design of KERA. Hombeck reports 
that they are, in fact, the same model, with only slight nuances of difference. Table 2 compares 
some of the basic features of the two initiatives. 

Table 2. Comparison of Key Elements of Children Achieving and KERA 



Elements 


Children Achieving 


KERA 


Origin of the reform 


The Superintendent’s plan to address a 
dire situation; no legal mandate. 


State law passed in response to a 
Supreme Court finding that the state 
education system was unconstitutional. 


Standards 


Explicit content standards developed by 
district committees. Distributed in Year 
1 of the reform. 


Goals and broad academic expectations 
defined in 1990. Standards were implicit 
in the assessment system (KIRIS), but 
core content standards were defined in 
1996. 


Curriculum 


To be developed by SLCs based on the 
standards. 


State curriculum framework issued in 
1994, but curricula are developed by each 
school in response to KIRIS and the 
state’s academic expectations. 


Governance 


Local school councils, including teachers 
and parents, are being elected. Authority 
is not yet clear. 


School-based decision-making councils 
with parent majorities with budget and 
personnel authority mandated for all 
schools except for those that exceed their 
performance targets and choose not to 
have councils. 


School Organization 


Teachers are encouraged to form SLCs. 


Non-graded primary (K-3) mandated. 


Assessment System 


SAT9 used in grades 2, 4, 6, 8, and 11. 
Performance measures are being piloted 
in some clusters and schools. 


Performance-oriented state assessment 
(KIRIS) in selected grades. Portfolios in 
math and writing. Standardized tests 
added in 1996. 


Accountability 


Not yet developed. Proposed 
improvement targets for schools, as well 
as rewards and sanctions. 


Two-year cycles with school targets 
based primarily on KIRIS; monetary 
awards for school staff exceeding targets; 
strong sanctions for declining schools. 


Support for school staff 


Funds to schools for professional 
development and TLN. 


Funds to schools for professional 
development and support for Regional 
Service Centers. 


Social Supports 


Full-day kindergarten, Family Resource 
Network, school readiness initiative. 


Family Resource Centers; preschool; 
extended school services. 



While some similarities in the designs of the two initiatives are obvious, there are also some 
important differences. Enacted by the state legislature, KERA has the authority of state law. Most 
importantly, the legislature provided sufficient funds for its implementation. Children Achieving, 
on the other hand, is a policy document drafted by the Superintendent and adopted by the Board, 
not a state law. Since the Board has no authority to tax, it is dependent on other public and private 
agencies to fund the reform. The initiative had to be marketed to state and local policymakers, 
civic and business leaders and to various funders to gain their support. Additionally, the 
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Superintendent and the Board must still convince their own employees, and their unions, that the 
plan is sound and mutually beneficial in order to ensure a full-faith effort by everyone to implement 
the reforms. 

Another difference between Children Achieving and KERA is that, in the latter case, the 
assessment and accountability system — with both its rewards and sanctions — was enacted at the 
beginning of the effort, while in Philadelphia it is still being designed. In Kentucky, the 
instructional focus and the incentives were made clear from the outset. The new assessment 
system and high standards also increased public awareness of the need to improve performance, 
and the steady improvement in most areas over the past four years has helped to build public 
support. 

Both initiatives have faced considerable opposition. KERA has survived three attempts by 
opponents to derail it. Six years of hard work by many educators and consistent gains on the new 
assessments have not yet persuaded a clear majority of the state’s citizens that it is working, 
although an increasing plurality say that they support the reforms. KERA continues because of the 
persistence of a coalition of education, civic, business, and political leaders deeply committed to its 
basic principles, and because this coalition has been willing to make adjustments in response to 
reasonable criticisms and thereby has avoided more damaging revisions advocated by opponents. 
Children Achieving also faces considerable opposition and must also build a strong coalition of 
champions if it is to have an opportunity to succeed. 

The Cluster Perspective on the Theory of Action 

The six initial cluster leaders appear to support the Superintendent’s basic philosophy and 
vision for the district, and they seem to understand the theory of action being advocated. In other 
words, they comprehend the centrality of the standards, the potential power of decentralization, the 
importance of support structures, and the critical roles they must play as facilitating leaders. 
However, they differ somewhat in their judgments about the plan’s adequacy as a guide for reform. 
Several leaders complained that there is no roadmap, no explicit process, for moving from the 
current to the desired state of affairs. One leader said, “Hombeck gave us the vision, but we have 
had to create a process.” In this view, the role of the cluster leader is to provide an explicit theory 
of action for realizing the broader vision. However, several other cluster leaders said that they 
were there to provide support to the schools, and it was up to the schools to decide how to move 
toward Hombeck’ s vision, suggesting that school staff had to develop their own theories of action 
about how to improve student performance. 

The opinions of cluster leaders also differed in their beliefs about whether schools had 
adequate capacity to realize the vision. Several expressed doubt that given decentralized authority 
schools would make “good” decisions about instructional reform and professional development. In 
their view, school staff lacked sufficient knowledge and experience and needed stronger guidance 
and assistance from the district and the cluster. In contrast, one cluster leader said that there would 
be no need for a cluster in five years; the schools would become self-governing organizations. 

Several cluster leaders felt that the district’s messages about Children Achieving tended to 
emphasize the parts rather than the whole. As a consequence, school staff members did not see 
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how the various pieces fit together, and the tasks seemed overwhelming. One leader said, “It is not 
a coherent program to [school staff], just a set of projects.” 

The School Perspective on the Theory of Action 

Impressions of the Children Achieving agenda at the school level vary widely. At this 
point, there appear to be five broad categories of response among school staff to the initiative: 

• it has brought new vitality and values to the system, and things are changing; 

• the agenda is sound, but not new; it reflects what we are already doing; 

• it simply asks too much given the circumstances — however noble, it is not realistic; 

• it is misdirected, threatening, or addresses the wrong problem; and 

• it is confusing and perhaps overwhelming. 

Given the absence of districtwide data, it is impossible at this time to estimate how many people 
fall into these five categories or how strongly they hold these views. However, two things seem 
clear: (1) the more direct contact teachers have with the development of Children Achieving, the 
more likely they are to be supportive; and (2) many staff in the first six clusters have been 
energized by the leadership provided by the cluster staff and the opportunities provided by the 
professional development funds. 

School members’ understanding of elements of Children Achieving vary according to the 
degree of their direct involvement in planning and implementation. Classroom teachers, busy with 
everyday demands, tend to be the least informed. Those involved in a standards writing team, a 
task force related to the Urban Systemic Initiative, or some other activity within a cluster tend to be 
better informed, since their participation may have brought them into closer contact with cluster 
staff. There are also indications that the amount of reform-related discussion that occurs in school- 
level meetings and planning sessions varies widely. Many of our interviewees said that they 
learned about Children Achieving from the media and admitted that, although they had the 
“booklet” (the Action Design), they really had not read it very carefully. 

In discussing Children Achieving as a reform agenda, school community members — 
teachers, administrators, and parents — focus on four elements: 

• the comprehensiveness of the vision; 

• the high expectations set for everyone, with students meeting performance standards and 
teachers being held accountable for their students’ learning; 

• the adequacy of school resources; 

• the increased family and community participation in decision making; and 
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the more intimate and cohesive teaching and learning contexts. 



The vast majority of the school community members interviewed agreed in theory with the major 
tenets of Children Achieving and, in particular, with its holistic approach. Their comments include: 

How can you disagree with it? It’s common sense. 

This is an air-tight reform agenda. 

The Ten Points make me conscious of the need to do all things all the time, to pay attention. 
To do it halfway is not good enough. 

But a central irony in most school community members’ perceptions of Children Achieving is that 
they are skeptical of whether it is “doable.” Citing resources as a primary concern, they doubt that 
such a comprehensive reform is feasible. They wonder: How can such an ambitious reform 
agenda be realized when funds are being cut? 

That is the most depressing thing about teaching in Philadelphia. Every year there is less 
money. I teach first grade and the books have to be consumable. I can’t use those books 
anymore because we can’t buy them. A lot of books are out of date. We don’t have books 
for every kid. It is like, when you sit down at dinner time, in the beginning you have an 
appetizer, a salad, something to drink, the entree, then desert. Every year they are taking 
something away: first the appetizer, then the drink. We almost have crumbs right now. 
And, the students we get now are hungrier. 

School community members also doubt the district’s ability to coordinate the implementation of the 
agenda at the central office, at the cluster level, and even within their own schools. Given the 
fleeting nature of many reform efforts, they also wonder if this one will endure: Will the district be 
able to sustain the focus and energy needed to implement the ten-point plan? 

School community members emphasized high expectations for student achievement in their 
descriptions of what is important in the new reform agenda. 

Children Achieving is about schools doing all they can do to provide services so that 
students can achieve. The root strategy is to put decision making at the school level, 
providing professional development so teachers adapt to students, increasing the use of 
technology, involvement of the parents. 

This ideal was often interpreted as paying more attention to those students most at risk for 
academic failure. Parents, teachers, and administrators alike recognized that teacher accountability 
would be tied to high expectations for students and that accountability itself was a salient 
component of reform. 

They also connected standards to accountability. But, here, they became less clear about 
specifics. They mentioned numerous sources for standards: NCTM, Project 2061, the 
Standardized Curriculum, and Pennsylvania’s outcomes-based education. They were unclear 
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about who would set the standards, how they would be assessed, who would hold them 
accountable for student learning, and what consequences they could expect if standards were not 
met. Some teachers welcomed “more objective” measures of their students’ progress. Others 
worried about the fairness of teachers being held accountable without a corresponding 
responsibility being placed on parents and the larger society for student achievement. They 
believed that this concern ought to be addressed in the reform vision and plan. 

I understand that Hornbeck wants to reward teachers whose students do well. The people 
who make up these activities and standards are not in the classroom. Until you’re in the 
classroom and you close your door, you find that you can’t do some of those activities with 
your students. Students can’t achieve unless teachers achieve. And parents and guardians 
must also have a share [of accountability]. 

In a few places, school community members described a growing “culture of accountability” that 
was a part of the fabric of the school community and was related to externally imposed standards 
for student performance. 

All of us [in the SLC] share the thinking that Children Achieving is a new notion of 
standards, performance, and evaluation of students. I believe it will bring us closer 
together as a small learning community. 

When most teachers and administrators spoke of family/community involvement, they 
referred to parents becoming more active in their children’s educations. They connected this 
involvement to “accountability for all.” Parents should be accountable for their children (especially 
for their behavior in schools) and society at large should be accountable for providing the resources 
necessary to support children’s learning, especially those most at risk of failing. 

Society doesn’t stop at the school doors. There’s one of me and 33 of them. The standards 
are going to get families involved. That’s what’s missing. I’m very involved. I call home 
to students. Family involvement is necessary for children to achieve. Otherwise they have 
no reason to. 

Some teachers and administrators expressed concerns about the appropriateness of parents 
participating in educational decision making. 

I see some of these parents who aren’t educated, some use crack. They aren’t articulate, 
and they don’t know how to get things done like parents in the Northeast might. I think 
that is unfair. When communities make decisions, the variables among them can be 
uneven. 

Few mentioned the relationship between engaging families and community in public schooling as a 
strategy for building public will to secure adequate funding and resources for schools. 

School community members expressed the most excitement about, and hope for, what they 
perceived to be Children Achieving ' s emphasis on creating more intimate and cohesive teaching 
and learning contexts for young people and adults. They pointed to improved articulation across 
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schools within the cluster and to SLCs as strategies directly related to creating educational 
coherence and trustful relationships. 

Now that we are in clusters, schools are in close proximity with each other. We share a 
newsletter together. We are hoping inter-school visits will occur... .Our vision is to increase 
sharing between faculties, resources, and schools. ..Clusters are smaller, more intimate. 
[T]he region was just too large to really get to know your neighbors. Or even to know one 
or two neighbors well. We are hoping that this will increase our intimacy, our relationships 
with other schools, and it is just beginning. 

Issues and Questions for Future Research 

The integration of components of Children Achieving and the linkages across levels are 
being designed as the reform is being implemented. It is hard to ascertain whether the apparent 
gaps or ambiguities in the emerging system are the result of inadequate design, uneven 
implementation, or the learning that must occur to accomplish something significant on such a large 
scale. The theory introduces standards, clusters, decentralized governance, small learning 
communities, teaching and learning networks, and a high-stakes accountability system. All of these 
components are new, and glitches should be expected. 

The theory of action will be put to the test in the next year as standards are implemented in 
schools and as accountability procedures are made more explicit, looming ever larger on the 
horizon. How will the clusters and schools respond to this challenge? Will cluster leaders step 
forward to offer schools a focus, or clearer choices? On what basis will such decisions be made? 
Will effective SLCs emerge, and under what conditions? How will teachers respond to the 
increasing pressure to improve performance, as well as to the increased opportunities for 
professional growth? 

What will the 16 new clusters learn from the first six? What path will they follow — will 
the cluster leaders offer schools a clear vision and focus their resources and energies, or will they 
encourage the schools to select their own direction, and chose to be responsive to school initiatives? 
What effect will the resource reductions have on their ability to stimulate change in the schools? 

Children Achieving does not offer teachers a clear and explicit vision concerning improved 
teaching and learning, although a vision — or visions — may be embedded in the assessments 
chosen, the professional development offered, and the partners selected. It is instead a theory of 
action that seeks to create the conditions and the capacity under which teachers will work together 
to develop or adopt their own strategies for improving teaching and learning. That effort is 
supposed to be undertaken by the SLCs. How well SLCs carry out that role will be a major focus 
of future research, as will the ways in which other elements of the reform influence their 
development. 

There are other important questions about how the theory of action will be translated into a 
theory of practice. One of the major issues raised by the theory is how the standards will affect the 
creation and functioning of SLCs. Another is how local school councils will interact with SLCs, 
and what their respective roles will be regarding teaching, learning, professional development, and 
hiring. 
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IV. The Context of Children Achieving 



Appraising the progress of Children Achieving requires some understanding of the difficult 
context within which it is being implemented. Its design and implementation have been affected by 
previous efforts at school reform in Philadelphia. The reform agenda has been modified to fit the 
confines of shrinking federal, state, and local education budgets, in addition to desegregation 
mandates handed down by the Commonwealth Court. State and city political leaders questioned 
the district’s reform strategies and priorities. Philadelphia Federation of Teachers union leaders 
have characterized the plan as an effort to take away teachers’ hard-won rights, impose reforms of 
dubious value, and hold teachers accountable for curing society’s ills. And media coverage of the 
reform has been uneven, sometimes offering support or raising important questions about the 
viability of the plan, and sometimes fostering public distrust of the system. How has the district 
has addressed these problems, and how have they impacted the progress of Children Achieving ? 

Historical Context 

In October of 1994, just two months after the Board of Education named David Hombeck 
as Superintendent, the Philadelphia Inquirer published a special section, “A District in Distress,” 
which graphically illustrated the desperate situation facing Philadelphia’s schools. The article cited 
declining test scores, severe segregation, inequitable resource distribution, and increasing poverty 
levels as “dismal” and “cause for despair.” Taken as a rough baseline for the new Hornbeck 
administration, the article’s statistics are sobering: 

• less than half of Philadelphia students entering high school in 1989 graduated four years 
later; 

• only 15 of the City’s 171 public elementary schools scored above the average on nationally 
normed reading tests; 

• students in only two high schools, both magnet programs, scored above the national 
average on the SAT; 

• test scores correlated directly with poverty levels (at the time of the Inquirer report, nearly 
half of all Philadelphia students came from families receiving public assistance); and 

• exacerbating the situation, Philadelphia had among the lowest per-pupil spending in the 
area, but had a tax burden twice as high as neighbors in suburban counties. 

Despite this discouraging situation, the School District of Philadelphia has a legacy of 
reform efforts prior to David Hombeck’s arrival. Many of these initiatives were highly regarded, 
and some were very similar to aspects of Children Achieving. Although cataloging every reform 
would be difficult, it is helpful to discuss a few of these initiatives here. 

In the mid-1980s, Superintendent Constance Clayton initiated a set of policies aimed at 
creating “Educational Excellence and Equity.” They included a standardized curriculum for all 
subject areas and a “pacing schedule” that suggested how teachers should move their students 
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through a course’s subject matter. A school improvement planning process was developed, and a 
citywide testing program was aligned to discrete curriculum objectives. The testing program 
provided schools with a tool to monitor student progress toward the achievement of goals specified 
in school improvement plans. 

Clayton also built new partnerships with higher education institutions and the private 
sector. This resulted in the creation of PATHS/PRISM (Philadelphia Alliance for the Teaching of 
Humanities/Philadelphia Renaissance in Science and Mathematics), a non-profit organization 
dedicated to supporting educational reform through professional development activities for 
teachers. 

Additionally, in 1988, The Pew Charitable Trusts provided a grant to develop the 
Philadelphia Schools Collaborative, an effort to restructure neighborhood comprehensive high 
schools. Large, comprehensive high schools were broken up into smaller units, or schools-within- 
schools, called charters. 

At the forefront of innovations in “blended” funding, Philadelphia was also an early adopter 
of Title I schoolwide projects — a Federal reform program designed to support academically and 
economically needy students. Eligible Philadelphia elementary and middle schools developed 
school leadership teams to oversee school-based decisions over Title I spending. Vocational 
(Perkins) and special education funding followed suit, and an ever greater degree of authority and 
decision making was passed down to schools. With encouragement from the business community 
and the Philadelphia Schools Collaborative, the district introduced school-based 
management/shared decision making (SBM/SDM) throughout the district. Unfortunately, this 
initiative entered schools at the same time that budgets were reduced. Many teachers and other 
staff became distrustful of SBM/SDM, viewing it as a device to cope with budget cuts. 

On a more positive note, Philadelphia has established teacher networks that provide 
vigorous contexts for teachers to explore their practice and investigate, individually and 
collectively, who their students are and how they learn. The Philadelphia Writing Project, the 
Teachers’ Learning Cooperative, Science Resource Leaders, the Math Science Congress, and the 
Gratz Connection are examples of the locally and nationally affiliated networks that have nurtured a 
growing corps of teacher leaders in Philadelphia. 

Additionally, in an effort to promote middle-management involvement in reform, the 
Philadelphia Elementary Principal Internship (PEPI) program was established. A selection and 
training program to groom new principals, PEPI was popular with those involved. Unfortunately, 
professional development of this type was never extended to new middle and high school 
principals, nor to experienced principals. 

None of these reforms proved to be comprehensive or powerful enough to alter the 
conditions of teaching and learning citywide. Some had positive effects in selected schools, but the 
dire statistics presented by the Inquirer reveal the limitations of these initiatives. They did, 
however, provide a starting point, introducing human resources strategies that could contribute to 
new school improvement efforts. 
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Public Awareness and Public Will 



Despite these “pockets” of reform, the School District of Philadelphia has been failing 
dramatically for many years, with little public outcry. A Philadelphia Primer , a plan submitted to 
Judge Doris Smith by seven external educational experts as part of the district’s long-running 
desegregation case (see below) cited “a failure of public will” as one of the reasons the system had 
served so many students so poorly for so long. 

While Constance Clayton’s 12-year tenure provided Philadelphia with a stability rare in 
urban districts, her tight management style contributed to a lack of community engagement in 
public schooling. Under her administration, information about student outcomes was difficult to 
access and rarely made public. This policy has changed under Hornbeck’s leadership; he believes 
that “only by knowing the dimensions of the problem will educators, elected officials and the wider 
community be able to make the decisions necessary to change them.” The Inquirer report, 
described above, was the first clear indication of this new policy. 

While assessing the level of “public will” for education reform in Philadelphia is beyond 
the scope of this report, it is clear that Children Achieving has generated increased public 
discussion about the city’s schools. Local media, particularly print media, have played a key role in 
this area. While the coverage has not always been positive, few Philadelphians remember a time 
when public education was more prominently debated. 

In particular, the Philadelphia Daily News, one of two major dailies, has assumed the task 
of monitoring the district’s activities. While the paper’s avowed goal is to stimulate public 
discussion of the reforms, the thrust of its stories seems to be to undermine public confidence in 
local education officials. In addition to reporting on the controversies surrounding Children 
Achieving, the paper has given front-page coverage to allegations of waste and abuse within the 
district, despite audits and budget reviews by independent groups which indicate that the Board is 
running a tight ship. The other major paper, the Philadelphia Inquirer, has staunchly supported 
Children Achieving in its editorials, but has given less coverage to the district’s activities overall. 

Both papers did encourage their readers to attend Public School Sunday, a communitywide 
effort to bring citizens and school leaders together to discuss public education. This kind of public 
discussion is unprecedented in Philadelphia. While some people feel that the media-generated 
debate about the schools has weakened support for Children Achieving, district leaders feel that the 
controversies and increased exposure have had the opposite effect, causing business, civic, and 
local political leaders to rally in support of the Board of Education’s agenda. In either scenario, 
Children Achieving has brought public education to the forefront of the public agenda in 
Philadelphia. 

The Fiscal Context 

When David Hombeck first proposed Children Achieving to the Board of Education, the 
estimated cost of full implementation was $1.5 billion over a five-year period, an increase of $300 
million annually over current funding levels. Unfortunately, the reforms were initiated during a 
period of declining funding for schools. In 1995, for the first time in five years, the Governor of 
Pennsylvania proposed a freeze on state aid to basic education. $ince Philadelphia relies on state 
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funds for more than half of its school budget, this freeze was a serious blow, particularly because 
school district officials had been hoping for a 2 percent increase in state aid to help fund Children 
Achieving. News from the federal government and the city was no better. Since 1993, the district 
has lost approximately one-third of its Title I money, and the city’s contribution to the school 
district is expected to decrease in 1997 due to a weak property tax base. Making matters even 
worse, the Philadelphia Board of Education, unlike other school boards in Pennsylvania, has no 
independent taxing authority. 

With fewer dollars flowing into the city and no ability to raise more, the school district 
faced a serious fiscal crisis in the first year of the reform initiative. In March, after making some 
difficult budget cuts, the Superintendent appeared before City Council with a proposal for a $1.4 
billion budget that included a $148 million deficit. The projected deficit included $58 million 
needed to maintain existing services in the district and another $90 million to fund Children 
Achieving. Because the City Charter required that the Board of Education produce a balanced 
budget by May 3 1 , the district was soon under pressure to fill the fiscal gap by making additional 
cuts. Not surprisingly, as district officials began to recommend eliminating such popular programs 
as after-school athletics, music, and other extracurricular activities, the public began to protest. 
During several City Council meetings, parents, community leaders, and business executives 
expressed the need for better schools and more money. Scores of witnesses called on the council 
to help prevent any further budget cuts. Yet, few individuals, including school district officials, 
recommended raising taxes to fund the deficit. There was near-universal agreement that 
Philadelphia taxpayers were already overburdened, and that raising taxes would be 
counterproductive to the city’s revitalization efforts. 

The fiscal crisis facing the school district and the public outcry about budget cuts soon 
dominated media coverage, and some city officials began to question the necessity of Hombeck’s 
plan. In the initial stages of budget deliberations, City Council President John Street publicly asked 
whether the $90 million needed to fund Children Achieving could not be put to better use by 
paying for additional teachers and buying more books for students. The challenge for school 
district officials was to keep parents, students, teachers, and principals focused on the inadequacy 
of funding by the state and city, rather than blame Children Achieving for “causing” the district’s 
budget crisis. 

As the budget deadline grew closer, the City Council approved legislation that re- 
authorized city taxes, giving the schools a one-time $15 million increase above and beyond the 
projected revenues. The state legislature also contributed another $14 million to the school district, 
but a large budget gap remained. 

In its final budget proposal, the Board of Education cut $67 million from the reform 
agenda, $20 million from instructional expenditures, and $18 million from administrative and other 
non-teaching costs. The budget crisis has forced a scaling-back of support for the reform agenda in 
the coming year. The next 16 clusters will be brought on-line with fewer resources than the first 
six. For example, the first six clusters received $ 18 per student for improvement activities, but the 
next 16 will receive only half of that amount. 
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The Court 



The recent budget crisis illustrates some of the challenges posed by Philadelphia’s political 
and fiscal environment, and its aftermath sheds light on yet another issue: the complex relationship 
between the school district and the Commonwealth Court. As soon as the budget was passed, 
Judge Doris A. Smith summoned the Superintendent to appear in Court to face contempt charges, 
citing his failure to fund programs, such as universal full-day kindergarten and pre-school, which 
she had ordered as part of her decision in the district’s desegregation case, Pennsylvania Human 
Relations Commission (PHRC) v. School District of Philadelphia (SDP). With bailiffs ready to 
escort him to jail, the Superintendent pledged, with the support of all nine members of the Board of 
Education, that the Judge’s programs would be funded, either through resources from the state or 
cuts in other areas. Although the crisis was temporarily diffused, this drama demonstrates one of 
the most important factors effecting the implementation of Children Achieving — the Judge’s 
influence over the school district’s policies and priorities. 

Although the desegregation case has been in progress for nearly 30 years, the Judge’s role 
has only recently been magnified. Until 1983, PHRC v. SDP was characterized by the usual 
desegregation debates: the plaintiff, the PHRC, favored mandatory solutions to the problem, 
including busing and forced school pairings; the district opposed such measures and, for the most 
part, successfully resisted the plaintiffs attempts to have the court impose a solution. Plans to 
reduce segregation relied largely on the creation of magnet schools and voluntary transfer 
programs. 

A turning point came in 1983, when the district was ordered to modify its 1976 
desegregation plan which was ruled a failure. Still opposed to mandatory busing, the SDP 
developed the Modified Desegregation Plan, which effectively transformed the lawsuit into an 
argument for systemwide educational equity. In addition to traditional magnet school and 
voluntary transfer desegregation options, the Modified Desegregation Plan espoused higher 
graduation and promotion standards and increased professional development and community 
mobilization. 

By broadening the scope of the lawsuit, the Modified Desegregation Plan also widened the 
Court’s purview over school district operations, setting the context in which Children Achieving 
reforms are being crafted and implemented. While the Superintendent has consistently emphasized 
the common ground they share, the relationship between the Judge and the district has become 
increasingly unpredictable. Early in his administration, Hombeck convinced Judge Smith that 
Children Achieving would fulfill her Court order. Apparently in harmony with the Judge’s wishes, 
the district prepared to submit the Children Achieving Action Design as a blueprint for reform. 
However, when the Action Design was submitted to the Court in February of 1995, the Judge’s 
three-member monitoring committee responded by issuing a critique of the plan. Yet, only two 
weeks later, after hearing testimony from Hornbeck and his top aides, the Judge rejected the 
findings of the monitoring committee and announced she was “tremendously reassured” about the 
viability of the reform plan. 

Even after this endorsement, Judge Smith ordered the school district to revise Children 
Achieving to include school uniforms, more magnet schools, and increased family involvement. 

She also criticized the school district for proceeding with reforms, particularly the cluster 
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organization, that she had not authorized. The Philadelphia Inquirer, while acknowledging Smith 
and Hombeck as the “key players” in the city’s education reform efforts, editorialized that the 
Judge’s order showed an “alarming tendency to micro-manage the school district in ways that 
could seriously hamper the progressive agenda crafted by David Hombeck.” More recent dramas 
illustrating friction between the Court and the district include the threatened jailing of the 
Superintendent (described above) and the Judge’s ruling restricting the role of the Philadelphia 
Education Fund in developing standards and providing professional development for the district 
(see below for further detail). 

Paradoxically, while the Judge’s rulings and critique of Children Achieving have 
sometimes created problems for district officials, she has also proven to be a powerful supporter of 
the city’s schools and the Children Achieving agenda. She issued what Michael Churchill, lead 
counsel of the Public Interest Law Center of Philadelphia, described as an “extraordinary opinion” 
when she joined both the Commonwealth of Pennsylvania and the City of Philadelphia as co- 
defendants in the lawsuit. The Court’s rationale for this decision was a ringing endorsement of 
Children Achieving, stating this was the first time in the suit’s history that the district had 
developed a viable reform plan. This order may put pressure on the state and the city to provide 
the additional resources needed to support Philadelphia schools. 

Recently, the state Supreme Court reviewed the extent of the Commonwealth Court’s 
orders in PHRC v. SDP. They took oversight of the case, warning Judge Smith that her rulings 
were treading too far beyond the scope of desegregation issues. It is unclear what effect this will 
have on Judge Smith’s role in the case, but it is likely that the Courts will continue to influence the 
implementation of Children Achieving. 

Political Context 

The school district and the Children Achieving agenda have been threatened with one crisis 
after another. Even the New York Times reported that the Superintendent “faces a battle on all 
fronts.” These “fronts” are not limited to critical media, fiscal crises, and legal mandates; the 
Board also has been forced to contend with criticism from its most potentially powerful supporters: 
the Commonwealth of Pennsylvania and the Philadelphia City Council. 

The State 

In April 1996, Judge Smith added the state to the 25-year-old desegregation lawsuit against 
the School District of Philadelphia, making it potentially responsible for paying some of the costs of 
her mandated reforms. To avoid this financial responsibility, state officials argued that the school 
system had both the capacity and resources to enact all of the reforms mandated by the 
Commonwealth Court and to balance its budget — all it had to do was cut many of the components 
of Children Achieving. Attorney Edward Mannino, who was quoted in the Inquirer as calling the 
reform a “pie-in-the-sky” idea, did little to bolster public support for the Children Achieving 
agenda. 



In addition, the state contributed to the school district’s fiscal crisis by freezing basic public 
education aid. Since 1993, the state has shortchanged Philadelphia schools by $326 million, failing 
to keep spending levels consistent with its own funding formula. The number of children on 
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welfare in Philadelphia (which is part of the allocation formula) has increased by almost 20,000 
since 1993, but the “equalized subsidy for basic education” has not kept pace with the increase. 
District officials argue that if the state had simply followed its own funding formula, the Board 
would not have faced such an enormous budget deficit this spring. 

Governor Tom Ridge’s own school reform priorities underlie the debate over state funding 
for Philadelphia’s public schools. The Governor has made no secret of his support for a voucher 
plan in Pennsylvania. He proposed spending an additional $42 million for vouchers in fiscal year 
1995-96, and his plan would increase this figure to $340 million in the fifth year. He argued that 
this additional money could be allocated with no reduction in the state aid already committed to the 
Philadelphia public schools. City officials were left to question why some of the funds could not be 
used to support the reforms proposed by Children Achieving. 

The City 

While Mayor Edward Rendell has been a consistent supporter of Superintendent Hombeck, 
other city officials have been skeptical. Although Hornbeck was ultimately able to convince City 
Council to back the reform, Children Achieving initially faced staunch opposition from City 
Council, particularly from Council President John Street. In addition to questioning the usefulness 
of Children Achieving, the council raised the issue of the residency of Hornbeck’s cabinet and 
questioned how the school district proposed to allocate funds. 

In 1983, the School District of Philadelphia established a residency requirement for new 
employees, but state law exempted workers hired before that date. During questioning by 
members of City Council, Hombeck revealed that 14 of the school district’s cabinet-level officials 
were living outside the city. Street demanded that Hombeck force these employees to move into 
the city, despite the fact that they were hired prior to 1983 and were thus legally exempted from the 
requirement. Street’s position was that these officials had a right to live outside the district, but not 
a right to serve as cabinet members. 

To put pressure on Hornbeck to comply, City Council delayed the vote on the authorization 
of school taxes — which produce 40 percent of the district’s revenue — until the Superintendent 
produced what they deemed a “rational and reasonable” policy on district employees who live 
outside of Philadelphia. Hornbeck acquiesced, announcing in March that all cabinet members 
currently living in the suburbs must establish residency in Philadelphia by July 1, 1997. Not 
surprisingly, the affected officials were upset. One unidentified administrator was quoted as saying 
that Hornbeck “sold his team down the tubes,” and it was reported that as many as ten of the 40 
cabinet members were considering leaving the district before the 1997 deadline. The first six 
cluster leaders also protested, writing a letter to Hombeck expressing their objection and 
threatening to leave the cabinet. They subsequently decided to remain in their positions. 

It was widely reported that Hombeck hoped his response to the residency issue would 
inspire City Council to lobby Harrisburg for increased school funding and possibly allocate more 
city dollars to the district. Ultimately, City Council did “find” an additional $15 million in the city 
budget to give to the schools (see above). 
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Council officials also questioned how district officials planned to allocate funds for the 
purchase of textbooks. During hours of public testimony over the proposed budget cuts, scores of 
parents and students described the deplorable conditions in their neighborhood schools. Numerous 
witnesses, one a particularly eloquent fifth grader, testified that many students did not even have 
the necessary books for their classes. After listening to such testimony, City Council questioned 
district officials on the amount of money spent per child on textbooks. After learning that the 
district currently spends an average of $53 per year per child on books, council members 
demanded that Hombeck amend his budget to increase this allocation. As this debate was played 
out in the media, Children Achieving was again portrayed as a reform that was taking resources 
away from the district’s capacity to meet basic needs. Street argued that perhaps the $90 million 
allocated for Children Achieving would be better used to hire additional teachers and buy more 
textbooks. 

While Council President Street was initially critical of Children Achieving, he ultimately 
chose to support the agenda. During a City Council meeting in May, Street helped the 
Superintendent explain some of the components of the agenda to other members. District officials 
viewed this as a breakthrough in their discussions with City Council. 

The Philadelphia Federation of Teachers 

Another factor that has affected — and will continue to affect — the progress of Children 
Achieving is the sometimes contentious relationship between district leadership and the teachers’ 
union, the Philadelphia Federation of Teachers (PFT). Many district officials see the union’s 
leadership and the current contract (in place during the 1995-96 school year) as major barriers to 
school reform. Conversely, the union leadership believes that Hornbeck is attempting to revoke the 
hard-won rights of teachers, impose reforms of dubious value, and make teachers accountable for 
solving the ills of society. 

Obviously, if both parties could find common ground for cooperation, it would be easier to 
accomplish changes in school organization and improvement in instruction. However, it is not 
clear that either party has made much of an effort to build such a relationship. Both sides say that 
the union has been invited to participate in the committees and workgroups associated with 
Children Achieving, but they also agree that the PFT has had little influence over the shape of the 
reforms or their implementation. They offer differing explanations of why this has been the case. 
District officials say that they have sought PFT participation and input, but that union leaders have 
not actively participated or, when they have, have often been obstructionists. The union says that 
the invitations have not been genuine — and have been, perhaps, manipulative. The union claims 
that they are not invited to the meetings “that count” and that, in reality, a small inner-circle of 
district officials makes all of the decisions. 

There is a long history of management-labor distrust underlying this troubled relationship, 
and objectivity is difficult for either party to maintain. It appears, however, that the district leaders 
have not made a whole-hearted effort to win the support of the PFT, and that the PFT is opposed to 
both the spirit and specifics of the reforms. 

Only a few days after Hornbeck presented his proposals for a new 1996-97 contract to the 
union, teachers voted overwhelmingly to authorize a strike if contract talks hit an impasse. While 
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this vote was routine, PFT President Ted Kirsch publicly criticized the Superintendent’s proposal 
as “punitive” and said that he expected a strike to occur. Many contentious issues were on the 
table: 

• Accountability. The Superintendent wanted to hold teachers accountable for student 
achievement by awarding group performance incentives when students did well and 
issuing sanctions when they do not. The PFT was adamantly opposed to this approach, 
arguing that the proposal was inherently unfair and divisive because of variations in 
teaching situations. While the Superintendent believed that it would lead to increased 
cooperation and productivity, the PFT feared it would result in unfair treatment and 
divisiveness. 

• Salary. In 1994, teachers received a 5 percent pay raise over a two-year period. However, 
the massive budget problems made raises a difficult issue — the larger the salary increases 
resulting from the current negotiations, the larger the district’s budget problem would 
become, and the more difficult it would be to fund the reforms. On the other hand, the 
district needed a committed and highly motivated workforce to make the reforms work. 

• Longer Days. Prior to talks, elementary teachers were required to work from 8:45 a.m. to 
3 p.m. (the shortest day in the Commonwealth), but the Superintendent wanted them to 
work from 8:45 a.m. to 4 p.m. The union was requesting extra compensation for this time. 

• Preparation Time. School district officials wanted to restructure teachers’ preparation 
time without increasing pay. The union viewed the district’s plan as reducing prep time. 

• Seniority. The Superintendent wanted to give individual schools the right to hire teachers, 
eliminating seniority as a factor in the decisions. The union wanted to maintain the 
seniority system. 

• Governance. The Superintendent sought increased authority for local school councils and 
SLCs. The PFT objected to giving parents authority over personnel decisions and asking 
teachers to take on administrative responsibilities without additional compensation. 

Fortunately a settlement was reached before the opening of school, and a strike was 
averted. Both parties expressed satisfaction with the new four year contract. The economic 
package was viewed by observers as both fair and fiscally sound; there was a slight increase in the 
length of the school day, some changes were made in the support provided to teachers receiving 
poor evaluations, and seniority rights remained in place. Both parties agreed that the accountability 
procedures sought by the superintendent and board were management perogatives and did not 
require changes in the contract. Most importantly, it was a four-year contract, providing an 
opportunity for the two parties to develop a cooperative working relationship in support of school 
improvement. The impact of the settlement on the progress of school reform will be tracked in the 
coming years. 
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The Business Community 



As a condition for receiving the $50 million from philanthropist Walter Annenberg for the 
Children Achieving initiative, the school district and its partners had to raise $100 million in 
matching funds — $50 million in government aid and another $50 million from a combination of 
foundations and corporations (as described in Section I). The effort has been headed by a non- 
profit group, Greater Philadelphia First (GPF), the parent organization of the Children Achieving 
Challenge, which represents the 35 corporations asked to contribute to the match. GPF provides 
management and fiscal oversight for the Challenge through the GPF Partnership for Reform, 
composed of representatives from the GPF board, community organizations, the school district, 
and the PFT. By June of 1996, civic leaders in Philadelphia had raised 92 percent of the required 
$100 million. 

The business community stood behind the Superintendent and his reform agenda during the 
difficult weeks when city council, press, union leaders, and the court were criticizing or questioning 
his leadership and plan. On June 16, business and civic leaders purchased space on the editorial 
page of the Inquirer to ask the community to come together in support of Hornbeck and Children 

Achieving. 

The Philadelphia Education Fund 

The Philadelphia Education Fund (PEF) was created in 1995 through a merger of the 
Philadelphia Schools Collaborative and PATHS/PRISM: The Philadelphia Partnership for 
Education, two long-standing and respected educational reform organizations. PEF is a non-profit 
organization affiliated with a network of other local education funds across the country and is one 
of the organizations eligible to receive matching funds for the Annenberg Challenge grant. PEF is 
supported by grants from funders such as the Pew Charitable Trusts, the DeWitt-Wallace 
Foundation, the William Penn Foundation, and the U.S. Department of Education. One of PEF’s 
primary goals is to raise funds to improve educational opportunities for children and youth in 
Philadelphia. 

PEF’s three-year $8.8 million grant from The Pew Charitable Trusts was designed to 
encourage a close working relationship between PEF and the district. As a result, PEF has worked 
with the district and the Children Achieving Challenge on the development of workplans for the 
programmatic areas funded by the Pew grant: Standards and Assessment, Teaching and Learning, 
and Leadership Development. PEF staff supported and coordinated the work of the teams 
developing the content standards for the district during 1995-96. 

In the spring of 1996, PEF entered the political maelstrom surrounding Children Achieving 
when the court, the media, and city leaders focused their attention on its work and its leadership 
along with that of the district and the superintendent. In March, a newspaper article alleged that 
PEF’s Executive Director, Warren Simmons, implied that racial politics were a factor in the public 
criticism of David Hornbeck and Children Achieving in a speech he made at a professional 
meeting in New Orleans. Simmons was subsequently asked to appear before City Council to 
explain his remarks. Additionally, in April, Judge Doris Smith ordered PEF to cease and desist its 
work with the district on the development of standards, arguing that PEF is “neither subject to the 
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requirements of the Public School Code of 1949.. .nor.. .to audit by the county controller or state 
auditor general. ..and is accountable to no government body or agency.” The district filed an appeal 
to that decision resulting in an automatic stay and PEF resumed its work on the standards late in 
the school year. 

Although it remains unclear what the long term impact of the turbulent events of the spring 
will have on PEF’s role in Philadelphia school reform, in the short-term, they weakened its ability 
to provide support to the district’s implementation of Children Achieving. 

Summary and Conclusions 

The School District of Philadelphia and its partners are trying to implement a broad and 
ambitious reform agenda in a highly turbulent environment. The political, fiscal, legal, and public 
relations problems described above already have affected the pace of reform and could, if 
unchecked, affect its long-term viability. There is no doubt they have affected public confidence in 
the district and support for reform. They also have consumed enormous amounts of time and 
energy, distracting district leaders from the tasks of implementation. And, the fiscal battles have 
left the district without the resources to fully support the reform efforts planned for 1996-97. 

Unfortunately, not all of these issues have been resolved, and some of them will continue 
to plague the district during 1996-97. The fiscal problems are projected to worsen next year. It 
seems probable that the court will continue to raise questions about the district’s priorities and 
operations. The impact of the new residency requirement will be felt in the coming year, as some 
key officials start to look for other positions and leave the district with a “leadership gap” to be 
filled next spring. 

Despite these hurdles, the implementation of Children Achieving is proceeding, and district 
leaders express optimism about next year. They point to the growing support they are receiving 
from local political, civic, and business leaders as a harbinger of increased public support for the 
reform agenda. They believe that the public will rally behind their efforts and transform a 
turbulent, if not hostile, environment into one that is supportive of reform. 
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V. The Progress of Reform 



How much of the Children Achieving agenda was implemented during the 1995-96 school 
year, and what were its initial effects? This section of the report summarizes the major 
accomplishments of the past year and addresses some of the issues raised in the process of 
implementation. The major areas of activity in 1995-96 were: 

• completion of the seven district workplans for Children Achieving ; 

• implementation of a new form of district organization — the cluster; 

• development of content standards to guide the design of curriculum and assessment 
procedures in the schools; 

• creation of new support structures to assist schools — funding for professional development, 
the TLN, and the FRN; 

• development of new structures within schools to foster changes in governance and 
instruction — local school councils and SLCs; 

• design and initial implementation of a new assessment and accountability system tied to 
high standards; 

• implementation of full-day kindergarten in all racially-isolated elementary schools and early 
classroom leveling procedures; 

• engagement of community resources in schools via the Alliance Organizing Project and 
Project 10,000; 

• changes within the central office itself; and 

• attainment of $95 million of the $ 100 million required to match the Annenberg Challenge 
grant. 

The progress made in six of these areas is described in this section. The development of the new 
support structures is discussed in Sections VI and VII. Other aspects of the reform will be 
examined in a subsequent report. 

Table 3 summarizes the progress made by the district in the critical areas listed above 
during 1995-96. The data in the chart indicate that Children Achieving is in an early stage of 
implementation. While much was achieved during 1995-96, major elements of the reform were 
just being implemented at the end of the year, and other pieces are still being designed and 
negotiated. The primary drivers of the reform — the standards, assessments, and accountability 
procedures — were not yet in place at the end of the school year. Even in the first six clusters, 
where substantial progress was made, critical elements of school reform (the SLCs and local 
school councils) were just being put in place as the summer recess began. 
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Table 3. Major Components of Children Achieving 
Implementation Scorecard - 1995-96 



Children 

Achieving 

Elements 


No Action 
Taken 


Interim 
System in 
Place/ 
Develop- 
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Underway 


New System 
Designed 


Partial 
Implementa- 
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System 


New System 
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or Task 
Completed 


New System 
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Perceived as 
Effective 


New System 
Proved 
Effective 


District 

Workplans 










X 






Clusters - 6 










X 


X 




Clusters - 16 








X 








Content 
Standards I 6 






X 










Content 
Standards 13 7 




X 












Opportunity to 
Learn 
Standards 




X 












Teaching and 
Learning 
Network ‘ 








X 




X 




Family 

Resource 

Network 








X 




X 




Small 

Learning 

Communities 








X 








Local School 
Councils 








X 








Performance 

Standards 


X 














Assessment 

System 




X 












Accountabil- 
ity System 




X 












Public 

Engagement 








X 









6 Mathematics, science, social studies, English/language arts. 

^ Health, physical education, social studies, and world languages. 
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Based on this overview of progress, 1995-96 should be treated as a baseline year, and 
those concerned with the effects of the reform on teaching and learning should set their sights on 
1996-97 and beyond. The effects can be expected to occur in two overlapping stages, with 
widespread changes in school organization and structure, curriculum, and pedagogy generally 
preceding improvements in student performance. These changes are likely to occur in an uneven 
pattern, with high-capacity schools (see Section VII) making greater progress in the first few years. 

If Children Achieving is successfully implemented, if there are adequate resources in the 
schools, and if sound decisions are made about changes in teaching and learning, then it would be 
reasonable to expect the following patterns of improvement to occur: 

• in 1996-97, some schools in the first six clusters would show significant performance 
gains, while others would largely show stable performance or small gains; schools in the 
new 16 clusters would demonstrate some positive effects from adjusting their curricula to 
the new tests, but they would exhibit smaller gains overall; 

• in 1997-98, most schools in the original six clusters and some schools in the next 16 would 
begin to show significant gains; many schools in the 16 “new” clusters would show stable 
performance; and, across all 22 clusters, a small number of low-performing, even 
declining, schools would be identifiable; and 

• in 1998-99, the majority of schools districtwide would continue to make significant gains; 
some schools’ performance would stabilize, requiring more district assistance; and some 
low-performing schools would make gains in response to district interventions. 

Based on the experience of other comprehensive reform initiatives, such as those in Kentucky and 
Chicago, evidence of sustained increases in student achievement across the district is not likely to 
appear before 1998-99. And, of course, this projection assumes that a more stable environment 
than the one evident in 1995-96 will develop and that adequate funding will be available. 

The Children Achieving Challenge Workplans 

Seven workteams were assigned the responsibility of translating Children Achieving s ten- 
point reform agenda into detailed implementation plans. The teams were assembled by the 
Children Achieving Challenge and the school district. Their work was critical because the 
Challenge Oversight Committee mandated that Challenge funds would not be allocated for tasks 
until a workplan was approved. In some cases in order to move forward with the reforms, the 
district had to spend its own funds with the understanding that they would be reimbursed by the 
Challenge once the relevant workplan was approved. 

Workteams were led by senior district officials and/or leaders of partner organizations, and 
their members included representatives from appropriate units in the central office, the schools, the 
PFT, and various partner organizations such as Greater Philadelphia First, PEF, the Alliance for 
Public School Advocates, local universities, and other participating organizations and groups. The 
Children Achieving Challenge provided resources and technical assistance to the workteams. 
Beginning in the summer of 1995, and continuing through the fall and winter of 1995-96, the teams 
met to develop plans for: 
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• productivity and management; 

• teaching and learning, and SLCs; 

• standards and assessment; 

• school -to-career programs; 

• leadership development; 

• the FRN; and 

• evaluation. 

These plans established a more detailed vision of the reforms, identifying strategies to be used and 
specific tasks to be accomplished. Drafts were reviewed by workteam members, the 
Superintendent’s cabinet, cluster leaders, central office staff, union leadership, members of the 
Board of Education, and partner organization staff. The plans were subsequently approved by the 
cabinet, the Board, and the Children Achieving Challenge Oversight Committee. 

The workplan process proved to be a mixed blessing. On the one hand, it was highly 
participatory and brought together individuals from within and outside the district who otherwise 
would neither have had the time nor the opportunity to discuss policy. The dialogues raised issues 
that required discussion, sometimes led to a new consensus about what had to be done, and 
sometimes created new working relationships. The plans were significantly improved through this 
process. 

On the other hand, the process itself was slow and not well-understood by those who were 
not members of the workteams. Although there was broad participation, some central office and 
school staff members perceived the process to be top-down and relatively closed. Also, the 
pressure to complete the plans quickly and obtain approval sometimes caused workteam leaders to 
put important and unresolved issues aside. 

Overall, most participants thought it was a worthwhile process. The workplans will be 
updated annually based on the progress made, evidence of effectiveness, new information and 
opportunities, and changes in local context. 

The Clusters 

The first six clusters became operational in 1995-96. They included 67 schools with a total 
enrollment of approximately 60,000 students. Each cluster provided leadership and support for 
reform in a small grouping of K-12. The new organization moved planning and decision making 
closer to the schools in order to increase participation of school staff and enhance their motivation. 
Each cluster office maintained a small staff to handle administration, work on public outreach and 
engagement, and support the efforts of the schools to plan improvements and implement local 
school councils, SLCs, and the FRN. Each cluster had a leader, one secretary, an administrative 
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assistant, a Teaching and Learning Coordinator, an FRN Coordinator, and a number of Teaching 
and Learning Facilitators (four to six) and Instructional Support Teachers (two to four). 

Overall, the six clusters made considerable progress in 1995-95. (The implementation of 
specific elements is discussed below.) The cluster leaders recruited staff, set up an office, 
established working relationships with principals and school staff, determined how to allocate 
operational funds, participated in fund-raising, and set priorities for improvement. The workload 
and pace were demanding. However, all six clusters established successful working relationships 
with their principals, initiated a number of clusterwide improvement efforts, found external 
partners to assist them, and persuaded and helped schools to implement the organizational and 
governance changes associated with Children Achieving. 

Each cluster leader defined his or her role, and the roles of cluster staff, somewhat 
differently. Some were more proactive, offering their schools a vision for the reform of teaching 
and learning and specific strategies for instructional reform; others tried to facilitate the 
development of a consensual vision with the schools; and still others chose to be responsive to 
needs and priorities defined by the schools themselves. These strategic differences are discussed in 
Sections VI and VIII. 

School participants noted the benefits of increased communication and better articulation 
across schools at different grade levels. They also understood the advantage in pooling resources 
for purchasing curriculum and consultant services clusterwide. Acting collectively, schools were 
able to extend their individual capacity to purchase curriculum materials and training. Having a 
common direction or program across a cluster also contributed to improved articulation. 

Cluster leaders faced a number of problems. Perhaps foremost was overcoming the 
resistance and skepticism of principals and teachers. Based on our school data, cluster leaders 
have not yet solved this problem, but they have made considerable progress. They made some 
headway with winning teachers’ support for aspects of the reform despite PFT’s public opposition 
to Children Achieving. They also gained the respect of most of the principals we interviewed. 

Cluster leaders undertook the difficult tasks of motivating staff to take risks and make 
changes and of setting a direction for their schools without the aid of the principal drivers of 
reform — the standards and the accountability procedures. Many school staff did not understand or 
fully accept the vision of reform emanating from the central office, and cluster leaders had to act as 
translators and advocates. The content standards developed by the New Standards project were 
intended to serve as interim guides for teachers, and were distributed and discussed, but they did 
not seem to have a significant effect on practice. However, the district’s interim assessment 
instrument, the SAT9, did provide a focus for changes in instruction and curriculum. 

While the cluster leaders reported adequate communication and support from the Office of 
Schools, they complained about poor communication with other offices and the slow pace of 
change in the central office. Most leaders felt that budget and purchasing procedures were still too 
slow and cumbersome. They also objected to inadequate lead time, which frequently necessitated 
last-minute decision making. Cluster leaders felt that artificial deadlines set by the central office 
for implementing SLCs and local school councils were forcing schools to take action before they 
were ready. Several said that the central office was pushing decentralization too quickly, 
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transferring responsibility to unprepared school staff. They also complained that the size of their 
support staff was inadequate to handle the workload being shifted to their offices. 

The 16 clusters scheduled to become operational in 1996-97 face major challenges. With 
at least one less staff member and smaller operational budgets, they will have to work with even 
fewer resources than the original six clusters. They also may find it harder to raise external funds 
due to competition with 21 other clusters. The dual supervisory structures used for the TLN, FRN, 
and new Equity Support Coordinators will be tested when central office staff find themselves 
coordinating and supporting the efforts of 22 staff, rather than six. Going systemwide will put the 
cluster theory to a critical test — does the cluster organization itself have intrinsic benefits for 
improving performance? Implementing new structures and relationships in 67 schools is no small 
achievement, but it still represents only slightly more than one-quarter of the district’s schools. 

The Standards 

The centerpiece of Children Achieving is the development of content and performance 
standards, which are expected to shape curricula and professional development, stimulate 
instructional improvement, and drive performance. In 1995-96, the New Standards Project’s draft 
content standards were used to provide interim guidance to schools in the first six clusters. Most 
observers did not feel that these interim standards had a great impact on teaching or learning, 
possibly because most school staff did not use them, preferring instead to wait for the district’s 
standards. 

The development of district standards was a cooperative effort between the district and 
PEF until April of 1996, when Judge Smith ruled that the process could not be delegated to an 
external group. PEF and the Office of Standards, Equity, and Student Services (OSESS) had 
provided staff support and information for the seven standards writing teams composed primarily 
of parents, teachers, and administrators. In fall and winter 1995-96, the writing teams drafted 
standards for math, science, the arts, and English/language arts and then revised them in the spring. 
They were distributed to expert reviewers in late spring, reviewed by broad-based teams of 
teachers, administrators, and parents, and subsequently revised in-house. This version was 
distributed to all teachers at the end of the school year. Further revisions will be made based on 
feedback from teachers. Current plans call for the Board of Education to adopt the standards late in 
1996 for implementation in the 1996-97 school year. 

Standards in the remaining subjects (health and physical education, social studies, and 
world languages) will be developed during 1996-97, and the “cross-cutting” standards will be 
embedded in the subject-oriented standards. Opportunity to learn standards will be developed in 
the fall of 1996. 

The Schools 

In order to improve instructional practice and student performance, teachers require a clear 
understanding of the relationships among standards, curriculum and instruction, and assessment. 

In the eleven schools studied in the spring of 1996, teachers’ awareness of these relationships 
varied. Staff in all of the schools reported some professional development related to standards by 
the TLN and/or the Urban Systemic Initiative and Project 2061. All of the elementary and middle 
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schools reported professional development on the new SAT9 testing program. Examples of the 
use of standards in two schools are described below. 

School A 

Interview/s in this school revealed confidence about the staff's ability to meet expectations 
regarding standards. Over the past five years . involvement with PATHS/PRISM's Partners in 
Change (now part ofPEF) and Project First has provided rich professional development 
experiences and practice in curricular development. The previous principal is credited with 
planting the seeds for such efforts. “He wanted us. ..on the map , raise the name. ..to a positive 
light.. .get teams organized around curriculum changes. We had a partnership with 
PATHS/PRISM and had many ‘ Partners in Change ' workshops and seminars. Whatever 
interested our staff and whatever the school needed , he tried to get everyone on board. Teams 
went on retreats for thematic workshops. Our goals were to raise the scores in math through 
using the NCTM standards across the curriculum . All the subjects are now trying to incorporate 
science across the curriculum as well as writing across the curriculum . ” 

Teachers are presently receiving training in the development of rubrics, improving 
student writing, and introducing a greater degree of problem solving into math curricula. 
Teachers continue to be enthusiastic about these initiatives: “ [Standards are] an excellent idea 
that find ways other than paper and pencil to know what children are actually learning. Children 
Achieving has supplied computers , they instituted the Stanford 9 exam. Once I saw it, I had to 
reevaluate what I did in my own class . ” While many teachers may not be as receptive as this 
veteran teacher , who has been an active participant in many professional development activities, 
her comments and those of others in this school do reflect an acceptance of standards as a way to 
gauge and improve student performance. 

School B 

Standards assumed two dimensions at School B . The principal felt “ standards ” were 
needed for student behavior as well as academics . He discussed his resolve to improve the 
schools attendance and tardiness record and to hold students accountable for graffiti on school 
walls. In this context, “ standards ” meant establishing behavioral guidelines for students in 
order to improve morale and create a sense of safety within the school community . 

SLC coordinators and other teachers focused on the academic aspect of standards. 

Many expressed philosophical agreement with the goal of developing more rigorous and 
engaging approaches to teaching and learning. No one discounted the need to improve 
performance within the classroom. In fact, efforts to develop standards were cited as one of the 
most promising aspects of the reform. For example . one teacher relinquished her position on the 
PFT Building Committee in order to concentrate on the continued development and 
implementation of math standards. While she was hopeful about academic avenues for creating 
change, this teacher believed progress was being stunted by disorganization within the school, 
which inhibited the dissemination of information on professional development opportunities. 
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Small Learning Communities 



The district defined SLCs by their ability to conform to certain characteristics. SLCs 
should be: 

• heterogeneous — including all children; 

• multi-year — providing a close relationship among students, parents, and teachers lasdng 
longer than one school year; 

• unified — built around a theme or an instructional approach; 

• instructional — promoting strategies that help students reach high standards; 

• collaborative — providing time for teachers to work together and grow professionally; 

• a connected community — students and teachers spending most of their time in one 
community; 

• empowered — having the authority and resources to design their own instructional program; 

• accountable — responsible for improving student performance; and 

• small — having less than 400 students. 

The rationale is that more intimate and personal teaching and learning environments will 
motivate teachers, helping them to improve practice, create stronger bonds between teachers and 
students, and consequently motivate students to improve their effort and performance. Philadelphia 
has had experience with this approach through the “charters” in its comprehensive high schools. 

As discussed in Section II, a survey of principals indicates that schools are making progress 
in developing SLCs. In the 234 schools that responded to our survey, 410 SLCs had already been 
established. However, the names of some nominated programs (i.e., 1st Grade, Title I Program) 
suggested that not all of them met the criteria described above. 

The Schools 

While most staff members understood some of the basic features of SLCs, there was some 
confusion over how they would function in practice. In the elementary schools and some of the 
middle schools, staff generally understood the idea that SLCs should involve multiple grades and 
be theme-based, but many questioned whether SLCs needed to involve all of the grades, how a 
theme would be incorporated, and how SLCs would affect long-established grade-level groups. 
Even in high schools, where SLCs have been in place for a few years, there were questions 
regarding whether expectations had changed. While some settings had initiated bold experiments 
with new forms that could become SLCs, others struggled with the concept of what SLCs might 
look like in their schools. Some elementary schools were comfortable hosting a variety of forms, 
but other sites lacked ideas, models, and a sense that experimentation was sanctioned. Middle 
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schools had experimented with similar models in the past, and some staff members expressed 
cynicism about revisiting discarded approaches. 

The four elementary schools visited by the evaluation team were in the exploratory stage 
with SLCs. At three of these schools, processes were in place to develop a variety of SLC models. 
Staff in two of these schools, both of which had made significant progress in forwarding 
schoolwide pedagogical reforms in recent years, expressed uncertainty about SLCs. Their schools 
were already small and already had climates characterized by a close-knit faculty and caring 
relationships between teachers and students. Teachers and administrators wondered how SLCs 
would increase their schools’ ability to meet the academic needs of their students and worried that 
the energy and attention needed to create SLCs would distract from other teaching and learning 
innovations underway. Staff in another school, which did not have a productive history with reform 
and had not yet organized a process for planning SLCs, questioned the need for developing them at 
the elementary level. 

Unlike those in elementary schools, staff in the four middle schools had some familiarity 
with SLCs through their experience with “houses,” and many saw the value of these smaller units 
for students. Although all four middle schools had house structures in place, each school brought a 
different history to bear when considering how Children Achieving' s SLCs fit with their existing 
houses. One middle school planned to devote full attention to the further development of its 
houses. This school had successfully forged common ground among the staff on several teaching 
and learning initiatives; they now wanted to intensify their efforts at building strong houses with 
distinctive educational programs. At two other middle schools, houses were in place and valued, 
but the overall school conditions were less conducive to their support. Staff in a fourth middle 
school, which had been creating houses since it was built, expressed some skepticism over the 
house structure’s ability to make a difference for students. At this school, students and many 
teachers changed houses every year, although in 1995-96 a few teachers followed their students 
and reported that the relationships they fostered had had a positive effect on student learning. 

SLCs were in place at all three high schools. Some of these SLCs had established 
collaboration among teachers and a sense of “family” among students, while some had a thematic 
focus, indicated by their course offerings and/or methods of classroom instruction. However, staff 
at all three schools also reported a lack of progress in establishing basic supports for SLCs, such as 
control over professional development and roster integrity for teachers and students. For these 
reasons, high school SLCs seemed fragile. 

School C 

School C’s SLCs were loosely defined and included grade groups, thematic units, and 
multi-cultural efforts (i.e., Grandparents’ and International Day). Although it was never stated, 
staff and administration seemed hesitant to establish SLCs because they could potentially 
interfere with the group solidarity felt to be the school’s strength. Staff held notions about SLCs 
that were different from the district’s characteristics. “[At the summer institute] we found out 
that there wasn’t one definition of an SLC. They were still in the process of developing this 
concept and in elementary schools there is a real problem because high and middle schools have 
houses and charters. We don ’t have such a thing; but we have grade groups and we try to break 
down our meetings, our agendas, our topics to be discussed and ourfocus...A lot of things we do 
at our school we consider to be SLCs. There are no right and wrong answers to this. ” 
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School D 



SLCs were a priority at School D during the 1995-96 school year; three SLCs were up 
and running, and a fourth and final SLC was planned for the coming year. Many of the staff we 
interviewed were optimistic about the effect this last SLC will have on the school. They hoped 
that it would provide an opportunity for all students to choose the community they wanted to join. 
They also felt it had the potential to reduce the student population in the established SLCs and to 
discourage tracking by providing more attractive options to all students. 

Budgetary problems have obstructed the creation of small, stable, heterogeneous SLCs in 
School D. The shortage of teachers and an uncertainty over which teachers will remain in 
coming years precluded block rostering. One teacher’s comments revealed how previous, failed 
attempts have fueled cynicism among teachers: “I feel pretty optimistic [about the new SLC], 
although I shouldn’t. People have said, ‘Remember the Tech Prep charter? That was Perkins 
money, too. ’ Computers gone in a year. ..It fizzled out and they took everything. That could 
happen [ again ]. ” 

Local School Councils 

Local school councils (LSCs) are another key component of the Children Achieving 
reform, and the central office issued guidelines for their composition. Each council must contain a 
majority of teachers selected by a process that is determined by the PFT Building Committee, the 
principal, and the parents chosen by the Home and School Association. Middle schools and high 
schools must include two students on the council. To be an official council, 35 percent of the 
parents must vote in the election of the parent representatives. Until that target is achieved, a 
council only has interim status. 

The councils will consult with the school community and develop plans for public 
engagement; develop disciplinary and other schoolwide policies, such as security, maintenance, 
facilities operation and use, and transportation; review school improvement plans and budgets; 
make recommendations about teaching and learning through review of the curriculum; and report 
to the public. 

The 67 schools in the first six clusters were expected to hold council elections and have a 
functioning council by the end of the school year. Only 12 met the 35 percent target by June 1, 
1996; the remainder created interim councils. Cluster staff reported that schools faced 
considerable difficulty eliciting the participation of parents. The members of all 67 councils were 
provided with training. 

Most of the cluster leaders felt that this change to local decision making was rushed, and 
that neither the schools nor the parents really understood what was expected of them. Most said 
schools offered considerable opposition to the council concept . Two expressed the concern that 
the councils would not have any real power, and that, in the end, both teachers and parents would 
be disillusioned. 
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The Schools 



At the time of our fieldwork, eight of the eleven schools studied (one high school, three 
middle schools, and four elementary schools) had held elections and set up interim LSCs. None of 
the schools had met the 35 percent participation requirement. At three of these schools, the LSCs 
had not yet met because the PFT Building Committees objected to teacher participation without 
corresponding compensation. 

Three elementary schools and one middle school had structures and processes in place for 
broad participation in planning and decision making prior to the advent of Children Achieving and 
the LSCs. These schools had functioning leadership groups and had established schoolwide 
committees with clear responsibilities and authority for planning. The middle school, after building 
a strong schoolwide leadership team, was beginning to devolve authority to houses. At all four of 
these schools, teachers and administrators expressed the concern that LSCs would negatively affect 
the progress they had already made in shared decision making. It was unclear how the 
responsibility and authority of the LSC would fit with existing structures that no one wished to 
dismantle. They worried that participation in school wide committees would decline if a smaller 
group had the “real power.” At these four schools, LSCs were already meeting, but these meetings 
tended to be pro forma. Real decision making was invested in other school structures. 

At one elementary school and two middle schools, LSCs were stalled, because PFT 
leadership wanted compensation for teacher participation and/or further clarification about LSC 
authority. At these schools, and the two high schools that did not yet have LSCs, staff described 
bitter and contentious histories with school-based management and shared decision making. 
Teachers and administrators expressed cynicism and skepticism about shared governance. 

At one middle school and one high school, a substantial number of staff expressed some 
hope about LSCs, despite difficult histories and current conflicts. These two schools had, not 
surprisingly, encountered problems, but were plodding forward with establishing working councils. 
At both schools which were in different clusters, the TLN had provided effective support and 
training at pivotal moments. 

School E 

School E’s two most salient features were its “ democratic ” decision-making structure 
and its unified staff, who work together to meet the challenge of teaching disadvantaged children. 
Decision making, problem solving, and planning occurred in schoolwide committees. Teachers 
praised the principal for his ability to inspire staff members and to delegate responsibility and 
authority to others. One teacher said, “ The real secret of the school is the principal. He makes 
people feel like they want to go the extra mile. It is not an authoritarian situation here. In many 
schools the principal feels like he has to come out with a whip. That is not the way he works. 
Everyone signs up for different committees. ” 

Ironically, because teachers already felt empowered, the prospect of establishing an LSC 
received lackluster reception. The principal explained that, “the teachers didn ’t really want [an 
LSC] because they didn’t feel the need for it.. ..They were worried it would bring animosity among 
teachers. It divides. ’’ Teachers also expressed this concern and wondered what impact the 
council would have on the school’s popular committee structure. “In authoritarian schools, 
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teachers may feel that since the principal has only one vote they will gain more control over their 
destiny. But it is just the opposite here. We still don’t know how much power the council will 
have in contrast to the union or the leadership team or any of our committees. ” 

Nevertheless, the school made progress toward establishing a council, and some teachers 
seemed to be optimistic, viewing an LSC as an opportunity to build better connections with the 
community and to explore staff-development options. 

School F 

LSC members had been elected in School F, but the council was not fully operational. A 
teacher, also a PFT Building Committee member, explained the reluctance: "In 1993 we tried 
shared decision making. The Building Committee was thought to have too much power on the 
governance council. The faculty thought information wasn ’t being shared.. .There was a lot of 
resentment by the faculty.. .There is a bad taste left in everyone ’s mouth from the governance 
council. Those who were on the council before felt that nothing ever came from their efforts. The 
principal put out flyers announcing the forming of the council, people weren 't readily accepting. ” 

A parent volunteer expressed a different sentiment. "It’s a shared decision making 
situation. We sit down together and decide what is good for our school. No one is higher than 
anyone else on this council, majority rules. ’’ Such fresh perspectives may allow the present 
council to redeem the image of local decision making. However, at this point, it was not held in 
high esteem. In particular, the principal was disillusioned about site-based management: "How 
much decision making can I grant, if I’m not getting it from on high.. ..I’m still getting decisions 
from on high — do this and do that... decisions are still coming top down. ” One of the areas that 
particularly discouraged the principal was the budget. While a generous amount of money was 
promised to the school for professional development, she felt that she had to "jump through 
hoops ” to access it. 

Any action resulting from shared decision making appeared to be a spillover from 
curriculum reform initiatives that the school had successfully undertaken in recent years. 

Teachers met in houses to consider what they wanted in the curriculum. Each house had active 
parent volunteers who participated in planning. 

School G 

Governance was School G’s hottest issue last year. In theory, shared decision making 
found support among teachers, parents, and administrators, including the principal: "I’m 
comfortable sharing decision making.. ..It takes a while for people to have input.. ,.[Y]ou can’t do 
it alone, you need participation.... We are doing it collaboratively, so you won’t be able to blame 
me about the budget. ” Equity among LSC members appealed to some teachers: "Everybody ’s 
equal from the principal to the custodian on the local school council. You have parents, vice 
principals on there. Everybody has an opportunity for dialogue, and I think most things here get 
started by dialogue. ’’ 

But, in practice, the LSC provoked — more aptly, revealed — strong divisions among 
teachers, parents, and administrators. The deepest cleavages were between both parents and 
teachers and teachers and administrators. One parent noted the role that the LSC played in 
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giving voice to each of these factions: "The council, I see it as a voice speaking out for our 
students and myself as a parent, to our staff. A voice that needs to be heard about parents ’ 
rights, students’ rights, as well as staff rights. Us working together as a family, decision making, 
concerns about respect and discipline. ” 

During the process of establishing the LSC, conflicts between teachers and parents arose 
over two issues. The first conflict involved the council ’s meeting time. Parents wanted to hold 
sessions in the evening, because many of them worked during the morning hours. Several 
teachers balked at this idea, because they would have to travel to and from the building after 
school hours. After some dispute, it was agreed that the council would meet twice a month, once 
in the morning and once in the evening. 

The second and more divisive conflict emerged when choosing parent members for the 
council. The school community coordinator had been asked by the principal to select parents. 

The Building Committee representatives objected, stating that this procedure was improper, and 
turned to the cluster office for backing. Upon the cluster's suggestion, a ballot to elect parents 
was circulated. Unfortunately, these steps were taken without informing other council members, 
causing confusion and bitterness among parents and the school community coordinator, who 
defensively accused Building representatives of feeling threatened by "strong parents. ” As our 
research ended, the council had agreed to temporarily ratify the membership of the original set of 
parents in order to allow the full council to attend an upcoming cluster-sponsored retreat. The 
cluster has played a “healing and bonding" role in the school. It sponsored a retreat that the 
principal described as "an excellent effort. The best thing the cluster’s done. ” He credited the 
retreat with helping members to develop a common vision. 

Nevertheless, concerns remain about the council in particular and decision making in 
general. These concerns originated from two directions. A teacher council member explained 
that parents have yet to prove their ability to act as competent decision makers. For others, 
apprehension about the new governance structure revolved around issues of trust and the 
credibility of proclamations from “downtown. ’’ An SLC Coordinator explained that budget cuts 
feed fear: “We're given many more opportunities to decide on things, especially where 
professional development is concerned. But we are definitely not there, yet. There is a definite 
credibility problem. I have a lot of teachers who have been here 20 years. They get cynical. 

‘Here we go again. They’re not going to listen to us. They are going to do what they want 
anyway. ’ And sure enough, I'm sitting there with them all enthusiastic about how we’re gonna be 
block rostered, and I’m cut from the budget. So how do you keep credibility going when there 's 
no real support for what you decide ? ” 

Despite these concerns, a stubborn optimism was observed. Most agreed that the council 
was well conceived and preferred to see past experiences as building blocks from which the new 
council could ascend. "I think it is a matter of experience. A lot of time was wasted on 
semantics, learning things about majority rule. Paralysis through analysis. ...I think the present 
council has learned from that. ” 

Assessment 

Children Achieving envisions the establishment of a new assessment system that will 
provide multiple measures of the district’s progress toward new performance standards. These 
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measures are expected to include portfolios and performance-based assessments. In 1995-96, the 
performance measures had not yet been defined, and the only districtwide measure was the SAT9 
for reading, mathematics, and science in grades 2, 4, 6, 8, and 11. The SAT9 was administered to 
the 67 schools in the first six clusters in 1994-95. Some schools were exploring or piloting other 
measures, such as performance tasks, portfolios, exhibitions, and student work sampling. One 
cluster was using its own funds to administer the New Standards Reference Examinations in 
Mathematics. 

In the summer of 1995 and into the 1995-96 school year, district leaders engaged in 
considerable discussion over using the New Standards Project’s (NSP) Reference Examinations 
districtwide. In the end, they declined, because the examinations are costly, do not cover all core 
subjects, and had not yet established technical adequacy. However, both the NSP exams and the 
SAT9 are marketed by Harcourt-Brace, and it is likely that they will be linked in the future, 
permitting an easier transition to the NSP exams if the district decides that they provide better 
measures. 

Concerns about the fit between the state assessment and the new district standards were 
also expressed. The district is seeking waivers for some portions of the state test that do not appear 
to match its standards. 

The Schools 

Most of the schools had “pockets” (single classrooms, teams of teachers, or an entire SLC) 
in which longer-term efforts to implement innovative approaches to assessment had taken place. In 
the high schools, teacher experimentation with alternative assessment tended to occur in individual 
classrooms, although some SLCs had designed a year-end SLC-wide project or exhibition of 
student work. One example of a pocket of alternative assessment at the elementary level was a 
school in which the fourth and fifth grades were working on the use of rubrics for assessing 
writing. At a middle school, one house had made limited use of exhibitions. These schools did not 
have a critical mass of teachers engaged in shared conversations about teaching, learning, and 
assessment. As a result, professional development by the TLN and others were taking fragile, 
early steps toward standards-driven teaching and learning. 

Two elementary schools and one middle school, where there had been a focus on 
assessment for several years, had implemented whole-school innovations. For example, in one 
elementary school, portfolios traveled with students from grade to grade, and professional 
development time was allocated for review and discussion of these portfolios. Another school had 
instituted schoolwide writing prompts and engaged teachers in the collective assessment of student 
writing. In these schools, Children Achieving' s emphasis on accountability with closely linked 
standards for teaching, learning, and assessment was seen as legitimizing their own visions, 
providing a “kick in the pants” to those few teachers who offered reluctance or resistance. 

School H 

The staff of School H was rightfully proud of its work in developing and implementing 
rubrics, work sampling, thematic units, writing prompts, and group grading. In a near- 
unanimous vote, teachers had elected to extend each school day in order to allow for a monthly 
early release. They used this time for school improvement planning, group grading, professional 
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development, and general meeting time for committees. During one site visit, a tired but 
enthusiastic first-grade teacher displayed a thick folder of papers representing one student’s 
work. After illustrating the steps the student had undertaken as he learned to subtract, she 
explained that portfolios gave her “a much better sense of each child’s progress than giving an 
‘A ’ or an 7 ’. ” The principal explained that 1995-96 presented an opportunity to collect 
baseline data. Next year, they plan to focus on the writing of persuasive essays. 

Accountability 

The district’s top management took the first real step toward developing a new 
accountability system in 1995-96. The Superintendent and Board adopted 30 performance goals 
for the year, and the pay increases of all central office administrators and cluster leaders for 1996- 
97 were linked to the achievement of those goals. The Superintendent reported to the Board of 
Education on the goals’ achievement in September of 1996. 

Hornbeck proposed to extend the pay-for-performance approach to teachers and principals 
in the coming years. Following the Kentucky accountability design, student performance targets 
would be defined for 1996-97 for each school using the SAT9 and other performance indicators, 
such as attendance. The 1995-96 data would be the baseline for all schools in all 22 clusters. 
Schools would have two years to reach their targets, and monetary incentives would be linked to 
their performance. Sanctions such as limited access to pay increases or the reconstitution of a 
school would be enacted in cases of poor performance. These rewards and sanctions would take 
effect at the end of the 1997-98 school year. The proposed accountability system raises a number 
of difficult issues, including some serious equity considerations. The support provided to next 16 
clusters will be different from the first six, and the clusters have differential access to external 
funding. 

Summary and Issues for Future Research 

The district has made considerable progress in this first year of Children Achieving, 
completing all of the important development and implementation tasks that were planned. At the 
end of the first year, the first six clusters were operational, the standards were drafted, headway 
was made in changing school organization and governance, and a new testing system was 
established. Thus far, Children Achieving has developed a solid record of accomplishment. Even 
more encouraging is the fact that many participants at all levels think that the new cluster 
organization is working. 

Next year, however, promises to be more difficult, as content standards are adopted, 16 
new clusters begin their work, and the district moves forward with its new accountability system. 
These initiatives raise a host of important questions: 

• How will teachers respond to the new district standards? 

• How will new accountability indicators, such as the SAT9 scores and the standards, affect 
curriculum and instruction? 

• Will the next 16 clusters be able to implement the reforms at the same pace as the original 
six? 
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• What difference, if any, will resource differentials have on cluster performance? 

• What SLC forms will develop, and how will the standards, as well as the assessment and 
accountability systems, affect them ? 

• What effects will different forms of SLCs have on teachers and students? 

• In what areas of decision making will LSCs get involved? 

• How will the LSCs’ decisions affect the SLCs? 

• Most importantly, how will the variation in the rate of implementation, resources, and 
SLCs affect student performance? 

These and other related questions will shape the evaluation research over the next two years. 



60 



o 

ERIC 



Evaluation of the Children Achieving Initiative: Report on Year One 



55 



VI. Building Capacity for Instructional Reform 



Providing access to intensive, sustained, and high-quality professional development for 
administrators, and teachers is one of the ten components of Children Achieving. The district is 
committed to building the infrastructure and the school capacity required to support professional 
growth and the improvement of practice in classrooms. 

To foster and support professional development, the district and its partners have created 
several new organizations — two within the district and one outside of it. The TLN and the Office 
of Best Practices are the primary district vehicles for supporting the efforts of school staff to 
implement the new standards and SLCs, develop or adopt curricula, and improve teaching practice. 
The external partner, the Philadelphia Education Fund (PEF), is a non-profit education fund 
supported by public and private grants. PEF is providing a variety of services that support Children 
Achieving, including professional development in support of standards, literacy, development of 
SLCs, design of new assessment procedures, and leadership development. 

The district and the Challenge also have provided substantial financial support for 
professional development in the six clusters. Over $3.7 million went directly to the schools in the 
first six clusters to support ten days of professional development for school staff. 8 An additional 
$1.7 million in Title I funds was available for professional development in 46 eligible cluster 
schools. The cluster leaders also provided the schools with an additional $384,000 from their own 
budgets for professional development. The NSF-funded Urban Systemic Initiative trained and 
supported the work of lead teachers in math and science in each of the 67 schools. Some schools 
received additional support from the PEF through the Student at the Center and Library Power 
projects and from the William Penn Foundation for the Arts Empower program. Other schools 
received support from partnerships with business and civic organizations. The central office and 
the clusters have aggressively raised external funds to support curriculum development, 
professional development for teachers, and technology. In sum, a large investment was made in 
teacher development during 1995-96. 

School Professional Development Funds 

Decentralization of decision making is an integral component of Children Achieving, and a 
major step in that direction was taken in 1995-96 when individual schools received discretionary 
funds for professional development. Each of the schools in five of the six clusters received 
approximately $64 per child for professional development. The exception was Strawberry 
Mansion, where the amount allocated to the schools ranged from $53 to $100 per child. In 
addition, 46 of the 67 schools received Title I funds that could also be used for professional 
development. 



8 The financial information reported here is taken from the Office of Schools and the Office of Standards, Equity, and 
Student Services report, Professional Development Presentation for Cohort One Clusters (School District of 
Philadelphia, May 20, 1996). 
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Table 4. Professional Development Investments and Priorities by Cluster 




1 Cluster 


Schools 
(Title I) 


Investment 
in $ 1,000s 


Reported Areas of Emphasis 


Special Initiatives 


Audenried 


10 

(9) 


444 


Mathematics Standards 
Performance Tasks 
Whole Language 
Thematic Teaching (Star Lab) 
Algebra for All 
Use of Technology 


Cigna Partnership 
USI 


Chain 


11 

(0) 


721 


Use of Standards 
Whole Language 
Thematic Teaching 
Math Standards/Pedagogy 
Hands on Science 
Use of Technology 


NASDC in 9 Schools 

Learning Research and 
Development Center Initiative 
USI 


King 


15 

(9) 


1125 


Math Standards 
Thematic Teaching 
Alternative Assessment 
Reading/LA Pedagogy 
Conflict Resolution 
Team Building 
Hands on Science 
Use of Technology 


William Penn Grant 
School-to-Career Program 

Students at the Center Grant 
(PEF) 

USI 


Olney 


12 

(10) 


1302 


Use of Performance Tasks 
Standards-Based Teaching 
Coalition of Essential Schools 
Content Study Groups 

Developmental ly Appropriate Practice in 
K-l 


IBM Reinventing Education 
Grant 

Coalition for Essential Schools 
USI 


Strawberry 

Mansion 


8 

(8) 


899 


Use of Performance Tasks 
Student Portfolios 
Standards in Content Areas 

Developmentally Appropriate Practice in 
K-l 

Literature across the Curriculum 
Best Practices in Teaching 


NASDC in 8 Schools 
School-to-Career Program 
USI 


West 

Philadelphia 


11 

(10) 


1056 


Team-Building 
Small Learning Communities 
Inter-disciplinary Teaching 
Cooperative Learning 
Alternative Assessment 


William Penn Grant 
Penn-Merck Collaborative 
USI 

West Philadelphia Compact 
(PEF) 
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Comprehensive data on the use of these funds are not yet available. Data reported by the 
six clusters to the central office are displayed in Table 4. They provide some sense of the range of 
professional development activities in the schools, although many schools supported a much 
greater range of activities than those shown in the table. There was strong emphasis on the use of 
standards and on standards-based instruction. There also was considerable emphasis on helping 
teachers to prepare their students for the SAT9. Mathematics, reading, writing, and science 
received heavy attention, as did the use of alternative assessment procedures. Almost all schools 
provided some training in the use of technology, while some schools provided professional 
development geared towards implementing SLCs and school councils. 

The process of deciding how these professional development funds would be used varied 
somewhat from cluster to cluster and from school to school. In some clusters, priorities for 
professional development were determined through a collective process involving the cluster 
leader, principals, and TLN coordinators. In others, the decisions were made in the schools. In 
some schools, discretionary professional development funds sponsored teachers’ attendance at 
conferences or workshops on particular topics and paid for substitute services while they were 
away. In one school, the money was simply divided up evenly among all of the teachers; each 
received a $700 stipend to spend as he or she saw fit. 

However the funds were used, the opportunity for teachers to plan professional 
development in the schools and to decide how to spend the money was taken as evidence that 
district leadership was serious about its decentralization plans. Regardless of their opinion of 
Children Achieving, teachers and administrators felt respected professionally, had a sense of 
empowerment, and gained a boost in morale, because they were able to make their own choices 
about professional development. The ability to obtain and fund substitute service meant that 
programs were not disrupted and the costs did not burden the school. In addition, those who 
attended outside conferences and workshops provided turn-around training, which constituted 
much of the school-level staff development reported in our interviews. 

While placing decisions about professional development in the hands of school staff 
strengthened their sense of professionalism, it also generated some controversy. The district was 
taken by surprise when the press reported that 155 teachers, principals, and administrators were 
attending the Association for Supervision and Curriculum Development’s conference in New 
Orleans. The Daily News publicly reported the total costs of these trips and suggested that these 
teachers might be taking vacations rather than attending meetings. In response to the publicity, the 
district issued a new policy prohibiting more than two school staff members from attending any one 
meeting or conference at the same time. This policy immediately created problems for clusters in 
which several staff members were participating in various activities as teams. When one of the 
TLN coordinators complained to the central office, she was granted an exemption to the “two- 
person rule,” but was left confused about when and how it should be applied. On its face, the rule 
inhibits efforts to build teams or to encourage schools to work together on common improvement 
initiatives. Several of the cluster leaders expressed a desire to exert more influence over the use of 
professional development money allotted to schools, arguing that “someone needs to determine the 
needs of the organization as a whole,” and that “schools don’t have enough objectivity” to 
determine how the money should best be spent. Some of them felt that the resources should be 
more focused on schoolwide initiatives. They also argued that, because schools had so many 

63 

Evaluation of the Children Achieving Initiative: Report on Year One 



58 



opportunities, it often took them too long to decide how to spend it. School staff, on the other hand, 
complained about being asked to make decisions about spending professional development funds at 
the last minute, without sufficient time for reasoned consideration. 

Based on our interviews with cluster and school staff, we offer the following observations. 
When schools or its SLCs had, or were developing, a focus for their instructional improvement 
efforts, it was more likely that there was also focus and continuity in professional development. 
Where there was no such focus, and no process underway to develop one, professional 
development activities typically covered a broader range of topics and were more fragmented and 
personalized. 

The Teaching and Learning Network 

The TLN is the primary district mechanism for improving curriculum and instruction in the 
schools, fostering school improvement initiatives, and supporting instructional change. The TLN 
was established in the spring of 1995 to provide support and staff development activities in the 
first six clusters to help staff meet the challenges of Children Achieving. In 1995-96, the TLN 
consisted of six coordinators (one in each cluster) and 27 facilitators (four to six in each cluster), 
most of whom were former teachers and classroom support personnel. TLN members outside of 
this core group included school support staff, such as reading teachers, department heads, SLC 
coordinators, and instructional support teachers. The work of the TLN was sometimes conducted 
by a single facilitator and sometimes by teams of two to five members. The Network’s activities 
have taken many forms, including working with individual teachers, consulting with school 
committees, and conducting formal training with large groups. 

Greater Philadelphia First reported that the TLN spent approximately $14 million in 
Children Achieving Challenge funds this past year to improve teaching and learning. The district 
spent another $6.4 million, for a total of more than $20 million. These resources were allocated as 
follows: 



$1.5 million was spent on books and libraries in the first six clusters and other racially- 
isolated schools; 

$1.7 million was spent to establish “accommodation rooms” in elementary schools for 
children who are disruptive in class; 

$3.7 million was spent for teacher training and professional development in the 67 schools 
in the first six clusters; 

$8.2 million was spent for more computers, improved technology and access to computer 
networks, and the integration of the use of technology in classrooms; 

$1 million was spent on developing SLCs; 

$200,000 was spent on leadership development in the SLCs; 

$2 million was spent on the implementation of standards; and 
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• $2.1 million was spent on salaries and benefits for TLN personnel. 

The main objective of the TLN is to provide support to teachers as they redesign curricula 
and revise pedagogy and assessment procedures in accordance with the emerging district 
standards. The Teaching and Learning Workplan laid out five additional goals for the TLN: 

• to ensure that all students and teachers are members of fully functioning SLCs; 

• to ensure that all teachers, SLCs, schools, and clusters design their intensive, ongoing 
professional development with the foundation and knowledge of developmental issues and 
instructional practices appropriate for all students and with the aim of ensuring success for 
all students; 

• to restructure systemwide support for teaching and leaning, so that it includes a framework 
of standards and policies to ensure equity and accountability, dissemination of maximum 
knowledge about best practice, support for inquiry, and effective brokering of expertise; 

• to enhance school resources to provide additional elements vital to teaching and learning 
and SLCs; and 

• to build an information infrastructure around teaching and learning. 

In addition to these ambitious systemwide goals, the TLN is also responsible for assisting 
individual schools in meeting their own professional development needs. 

To begin this process, TLN staff met with staff in the 67 schools in the first six clusters in 
the fall of 1995. Working with the TLN staff, each school then developed an action plan that 
identified areas where assistance was needed. TLN staff revisit these schools and revise these 
plans as the needs of the schools change. Given the district’s emphasis on creating SLCs and 
developing standards-based curricula, the TLN coordinators indicated that much of their work 
focused on these areas in the first year. 

The biggest challenge facing the TLN in 1995-96 was gaining acceptance in the schools. 
They indicated that many teachers were initially skeptical and resistant, questioning how the TLN 
staff could possibly help them in their classrooms. It was anticipated that high school staff would 
be particularly difficult to convince, because many of the TLN coordinators have K-8 backgrounds; 
and that older, more experienced teachers would be more resistant. However, a recent survey 
conducted by the Office of Accountability and Assessment at the central office found that school 
staff at all levels have begun to see the TLN as a valued resource and as an influence on their 
practice. 

In order to find out how teachers were reacting to the TLN, district research staff 
interviewed a sample of teachers in the first six clusters. Two groups of teachers were randomly 
selected to be interviewed: (1) those who reported being served by the TLN; and (2) those who 
reported not being served by the TLN. A total of 186 teachers were interviewed in 40 of the 67 
cluster schools. Of the 186, 136 reported being served by the TLN. 
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Teachers who had been served by the TLN were asked to list the activities in which they 
had participated, rate its services, indicate if they used what they had learned in their classrooms, 
and report if the experience had led to better communication in their school. The teachers not 
served by the TLN were asked if they had heard of it, if they had received materials from it, and 
whether or not they thought they would benefit from the services it provided. 

Overall, the survey results indicated that teachers in these schools felt positively about the 
contributions of the TLN. Almost 90 percent of teachers served by the TLN responded that they 
found the services either helpful or very helpful. Contrary to expectation, there was little difference 
among elementary, middle, and high school respondents or among teachers with different amounts 
of experience. Most encouraging was the fact that 75 percent of the teachers who had received 
services from the TLN indicated that they were applying these skills in their classrooms. Again, 
there was little variation by level taught or by years of teaching experience. Finally, 80 percent of 
the teachers not yet served by the TLN reported they believed its services would be beneficial. 

In addition to the teacher survey, the Office of Accountability and Assessment also spoke 
with 40 principals about the TLN. Almost 80 percent reported that they found its services to be 
helpful or very helpful. 

The School Perspective 

What did the teachers interviewed by the evaluation team think about the TLN? How had 
their professional development changed? What use were they making of its services? Generally, 
our findings are consistent with those from the district study. 

Staff members in most of the schools considered the TLN to be a valuable resource. TLN 
staff had offered training in areas such as alternative assessment, standards, the new testing 
program, cooperative learning, team building, and implementing SLCs. Some schools also 
requested that TLN staff work with specific teachers, particularly new or “weak” teachers. TLN 
staff also assisted local teacher leaders/administrators in planning retreats and meetings and 
responded to special requests to assist with school-improvement planning. School staff considered 
training in the new forms of assessment to be particularly useful and instructive. 

Although most school staff valued the TLN, there were some schools in which the staff 
maintained a distance from it or were skeptical about them. In one reform-oriented school with 
exceptionally strong local teacher leadership and an ongoing staff development program, few 
school-level participants saw the TLN as valuable, and, indeed, its influence was not visible in the 
school. “I don’t really see their value,” was a refrain echoed by its staff as well as its principal. 
Most of the training on standards, assessment, and classroom practice in the school had been 
provided by members of their staff who were involved in the standards writing effort, USI, or local 
teacher curriculum/discipline-based networks. In another school with a history of reform initiatives 
a teacher noted, “We look inside for expertise first.” 

In other sites, especially in the high schools, some staff questioned the appropriateness of 
TLN facilitator/coordinator expertise. They saw TLN staff as being elementary- and middle 
school-trained, and they questioned the applicability of their knowledge and approach to the high 
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school level, where teachers believe they are more “discipline” based. For example, one high 
school SLC coordinator commented on how his staff received the TLN staff: “Teaching and 
Learning Network? People are cynical because they’re not high school. They see enthusiasm, 
creativity, child-centered.. .but think ‘that’s for middle school.’” One of the high school principals 
observed, “Staff are going to have to learn to respect generalists. It’s a paradigm shift.” 

Even if school staff members acknowledged the expertise of the TLN staff, they did not 
always think what was offered was appropriate for their schools. As designers of their own 
programs, they felt that they knew what they needed and preferred to pick and choose professional 
development programs to “complement” what they were already doing. They wanted choice, and 
when the TLN met their needs, they were willing to use it. If not, they were prepared to go 
elsewhere for services. For example, in the summer of 1995, one of the reform-oriented 
elementary schools sent staff to Pittsburgh to observe work sampling, where they consulted with 
the Pittsburgh school staff on other avenues of professional development and support for teaching 
approaches. The principal of a strong middle school commented, “When we need experts, we 
know where we want to go.” 

Office of Best Practices 

The Office of Best Practices was created in the spring of 1995 to help schools identify 
highly effective practices and materials. Its mission is to help schools and SLCs strengthen links 
between school plans, purchases of instructional materials and programs and professional 
development; and the district’s new academic standards; and research about instruction and 
assessment. Ultimate goals are for the office to improve the quality of the information about 
programs and materials available in the school district and to provide models of exemplary practice 
that are tied to evidence of improved student achievement. The rationale for providing this service 
is that it will save schools and SLCs time and energy in their searches for high-quality material. It 
will also eliminate some of the guess-work involved in such decisions. 

The Office of Best Practices is developing a database of promising work already being 
implemented within the district, along with information on effective practices from across the 
nation. Teachers will be able to access the information via the Internet. The system is already on- 
line, and, by the start of the 1996-97 school year, every teacher in the school district should have 
the capacity to call up the information. 

In addition to this database, the Office of Best Practices is disseminating information via 
Effective Practice Fairs. In late January of 1996, a fair on “Small Learning Communities and 
Programs that Support Them” was held at Edison High School. It consisted of 105 workshops and 
presentations conducted by district staff. Another fair was held in March to showcase high-quality 
practices and products from outside the district. It allowed teachers to inspect the products of 125 
different vendors. 

Although the Office of Best Practices has already begun to disseminate information, district 
officials admit that they are not yet ready to identify what constitutes “blue ribbon” practice. In 
fact, according to one official, simply deciding that the district should identify some teaching 
practices in this way was a struggle. Many teachers and administrators continue to be skeptical 
about developing criteria for rating the relative effectiveness of one practice over another, given the 
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number of mitigating circumstances in classrooms. However, district officials are determined to 
“push ahead.” The goals for next year are to establish an explicit set of standards for the 
identification of “blue ribbon” practices and to become a more effective filter for the products and 
programs entering the system. At the present time, there are no standards for exclusion. At the 
two Effective Practices Fairs conducted this past year, any vendor who paid the registration fee 
was allowed to display materials. 

The Philadelphia Education Fund 

The Philadelphia Education Fund (PEF) is an external partner in the efforts of the district 
and the Challenge to improve teaching and learning in Philadelphia. A non-profit technical 
assistance organization, PEF is supported by grants from The Pew Charitable Trusts, the DeWitt- 
Wallace Foundation, the William Penn Foundation, and the U.S. Department of Education, among 
other funders. It is one of the organizations eligible to receive matching funds for the Annenberg 
Challenge grant, and the Pew grant is part of that match. A significant portion of PEF’s activities 
focus on improving schools and enhancing student achievement; its other focus is collaborating 
with the district on the design and implementation of Children Achieving. The Pew grant has 
supported collaborative work with the district in support of the initiative, and other PEF grants such 
as Library Power and Students at the Center, both funded by the DeWitt Wallace-Reader’s Digest 
Fund are providing direct support to the schools. The North Philadelphia Compact, another PEF 
initiative, supports student services by building partnerships among higher education institutions, 
community agencies, and school staff. PEF also administers other foundation-supported projects in 
the arts. 



Although an outgrowth of two respected school reform initiatives — the Philadelphia 
Schools Collaborative and PATHS/PRISM — PEF is a new organization and is forging a new, more 
collaborative relationship with the district. Its new role is not yet well understood by all parties. Its 
staff view their work as stimulating and supporting improvements in teaching and learning by 
providing high quality technical assistance and building professional networks. But the PFT staff 
believe that PEF was created to avoid public scrutiny of the use of Annenberg funds. However, the 
Annenberg funds are the responsibility of the Children Achieving Challenge. In addition, 
Commonwealth Court Judge Doris Smith was concerned about PEF’s role, questioning whether a 
private organization should be taking a leadership role in developing standards for Philadelphia 
(see Section IV). 

PEF’s activities have been consistent with its mission of providing high quality technical 
assistance. PEF did work closely with the Challenge and the district through the workplan process, 
playing a leadership role in the development of the Standards and Assessment Workplan and a 
lesser role in the Teaching and Learning Workplan. PEF staff collaborated closely with the Office 
of Standards, Equity, and Student Services (OSESS) on the development of the content standards, 
a process which involved central office staff, administrators, teachers, and parents. Both PEF and 
district staff reported that this was a successful collaboration. The draft content standards were 
completed, but PEF’s work was slowed in April by the Commonwealth Court order forbidding the 
district to delegate such tasks to PEF (See Section IV). Following a district appeal of this order, 
the collaboration between the district and PEF has continued. 
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The collaboration itself has not been without problems. PEF has not yet established 
effective working relationships with the Office of Schools (OS) and in particular with the TLN. In 
sharp contrast to its strong and productive relationship with OSESS, these relationships are 
described by both sides as strained. PEF staff point out that all parties were working together in 
the summer of 1995, but once the new district organization took hold in the fall, the collaboration 
fell apart. As a consequence, PEF played almost no role in helping schools in the first six clusters 
set their professional development priorities or in assisting cluster leaders and TLN coordinators to 
think about approaches to teacher development and school improvement. 

Building effective working relationships is critical if PEF’s resources are to be used to 
develop the district’s capacity for instructional improvement. Respondents offered a variety of 
explanations for the problems that have beset these relationships. Some OS staff believed that PEF 
was spending “their money.” This misunderstanding arose from events that occurred in 1995. At 
that time the Office of Schools was just being formed and the district turned to PEF to help prepare 
schools for the implementation of Children Achieving. To bridge a time gap in PEF’s funding in 
the summer of 1995 until the arrival of the Pew money, the district took $2. 1 million from the 
Office of Schools and transferred it to PEF to run programs in collaboration with it. The funds were 
supposed to be reimbursed to the district by the Challenge, but the incident created tensions 
between PEF and the Office of Schools. This history has obstructed cooperation between PEF and 
OS. 



Another part of the problem may be that OS and TLN staff have simply been too over- 
burdened to collaborate with any external group. Turf issues also adds to the problem — both the 
TLN and PEF staffs claim expertise in professional development. The TLN is new and has to 
establish its legitimacy, and TLN staff want to “own the work.” PEF staff want their expertise and 
contributions to be recognized. Some district staff complain about PEF’s attitude toward them. 
“They feel that they are experts. They think we are just bureaucrats, and they do not see us as 
equals.” Conversely, PEF staff feel that their expertise has not been used effectively. 

At the same time, PEF staff believe that these problems are being solved. They feel that 
the release of the standards will provide the basis for cooperation in the future and they are working 
to forge stronger links with TLN and cluster staff. 

Other External Funding 

In addition to district support for professional development, the clusters and their schools 
were the recipients of other external resources. 

Urban Systemic Initiative 

Philadelphia is one of several cities that have received Urban Systemic Initiative (USI) 
grants from the National Science Foundation. The $15 million, five-year grant is intended to 
improve instruction in science, mathematics, and technology. The USI is providing professional 
development and materials for TLN coordinators and facilitators and for teachers. The USI trained 
two teachers from each of the 67 schools to serve as lead teachers for math and science and 
provided twenty hours of training to five teachers from each school. 
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The William Penn Foundation 



The West Philadelphia and Martin Luther King clusters are slated to receive $13.8 million 
from the William Penn Foundation for education reform. The grant will allow each of the 27 
schools to provide three extra hours of instruction a week to the most at-risk students and to stay 
open three hours longer each day for community-based activities. The money will also pay for 
seven additional hours of professional development each year per teacher, provide an extra $30 per 
student for books and $40 for computers, and pay for a teacher-facilitator in each school to help 
teachers improve instructional practice. A condition of the grant prevents the school district from 
reducing the operating budgets of the two clusters. 

The IBM Foundation 

The school district and IBM have formed a partnership to use technology as an integral 
component in designing professional development. The Continuous Practice Improvement (CPI) 
model will be implemented over the next year. Technology will be used to design new 
instructional approaches and to network teachers and administrators. The $2 million grant will be 
focused on the Olney Cluster, and it will involve Barton Elementary, Central East Middle School, 
and Olney High School. These schools initially will receive computer hardware, software, 
courseware, and training, and one classroom in each school will be outfitted with 6 computers. 

SchooI-to-Career Pilot 

Four years ago, the School District of Philadelphia initiated a school-to-career/work-based 
learning program that originally served only 12 students. The program has since expanded to 
include cohorts in 16 comprehensive high schools with 2,000 students involved in a multitude of 
career pathways. The School-to-Career Workplan developed for Children Achieving expands on 
these efforts. It calls for professional development, building a K-8 sequence for school-to-career 
transition, providing work-based learning experiences for all high school students, using technology 
to support the system, developing Next Step Centers to provide information on education and 
training to students, and strengthening external partnerships. During the 1996-97 school year, 
School-to-Career staff will be working intensively with the Kensington, Martin Luther King, and 
Strawberry Mansion clusters to implement the major components of the school-to-career system. 
Each subsequent year, the district and its partners plan to implement the full sequence of school-to- 
career programs in four to five additional clusters. The clusters will be selected on a voluntary 
basis. 



The budget for the School-to-Career Workplan was $2 million in 1995-96; it will total $4.4 
million in 1996-97. This sum includes funds from the Office of Education for Employment, grants 
received by the district, grants received by the Children Achieving Challenge, corporate 
contributions, and unrestricted Children Achieving Challenge funds. 
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Library Power 

Library Power is an initiative of the DeWitt Wallace-Readers’ Digest Fund, which 
supports programs in 20 sites around the country. PEF secured a grant for Philadelphia. Its goal is 
to create library programs that integrate classroom curricula; serve the needs of students, teachers, 
and parents; and function as a model for child-centered interdisciplinary teaching and learning. The 
project, a joint effort between PEF and the school district, enables schools to buy books, software, 
and furniture for their libraries. It also provides professional development for teams from the 
Library Power schools. At the present time, Library Power is supporting these activities in 30 
schools, some of which are in the first six clusters. 

Students at the Center 

The Martin Luther King and Gratz clusters are the beneficiaries of a $3 million grant from 
the DeWitt-Wallace Foundation. The money will distributed over the next three years to provide 
teacher and parent training activities in the areas of computer science, mathematics, science, 
writing, and leadership. PEF, Beaver College, the Franklin Institute, and the Philadelphia Writing 
Project will be working with the two clusters. 

Arts Empower 

Since 1992, the William Penn Foundation has collaborated with PEF (PATHS/PRISM) on 
the development and support of an innovative, interdisciplinary arts program in 16 Philadelphia 
public schools. Intended to spearhead school renewal, Arts Empower now provides intensive 
ongoing professional development for teams of teachers at 12 schools, representing different 
disciplines, around arts-integrated teaching and learning and school reform. 

Issues and Questions for Future Research 

Data on how these significant investments have affected teaching and learning are not yet 
available. Future research will address this question, but, to answer it intelligently and to 
contribute to improved decision making, other questions must also be posed. What are the patterns 
of use for professional development funds? How are these decisions made? Where do school staff 
look for information and assistance? To what degree are there focused, sustained professional 
development programs in the schools? How are these priorities determined? What contributes to, 
or obstructs, developing a focus within a school or SLC? How do staff assess the quality of 
professional development options? And, how does the support infrastructure affect the way these 
issues are addressed and resolved? The evaluation team will look for evidence by examining the 
co-variation among professional development approaches, responses to next fall’s teacher survey 
about changes in teaching practice, and outcome indicators. We will also use professional 
development strategies as one criterion for selecting the schools in which teachers will be observed 
and interviewed. 

Another set of questions will focus on how well the various parts of the system are working 
together. The Annenberg workplan acknowledges that the success of Children Achieving depends 
on coordinated support from the cluster offices, the TLN, the Office of Best Practices, the Office of 
Curriculum Support, and PEF. How do the Office of Best Practices and the TLN work together to 
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improve professional development in the school system? At present, the relationship between the 
two is unclear. TLN coordinators interviewed during this round of fieldwork were generally 
unaware of the Office of Best Practices’ work. It is worth noting that the two units are not in the 
same department of the central office and that their staff do not routinely meet. Development of a 
close working relationship between the Office of Schools, particularly the TLN, and PEF is equally 
critical. These organizational relationships are just being developed and are likely to change over 
time, so the evaluation team will be monitoring their patterns of interaction. 

There is also a need to investigate how priorities are set at the school and cluster level. On 
what basis do they decide to invest in a particular strategy, curriculum, or program? How does the 
TLN decide which instructional practices to emphasize? What role does knowledge play in these 
decisions, and what are its sources? Are these decisions informed by the Office of Best Practices? 
How are “best practices” determined? Will teachers and schools welcome, resist, or ignore the 
“filtering” aspect of the Office of Best Practices, given the emphasis on local decision-making in 
Children Achieving 1 

These questions will be addressed over the next two years, shaping both the teacher survey 
and the selection of the school sample for intensive fieldwork. 
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